-- Logs begin at Tue 2022-10-04 08:10:17 UTC, end at Tue 2022-10-04 09:16:14 UTC. -- Oct 04 08:43:01.927497 dv-cinder-844563-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 08:43:01.935104 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 08:43:01 2022] *** Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: nodename: dv-cinder-844563-14-iscsi Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: machine: x86_64 Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: clock source: unix Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: pcre jit disabled Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: detected number of CPU cores: 4 Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: current working directory: / Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: detected binary path: /usr/bin/uwsgi-core Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: your processes number limit is 47680 Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: your memory page size is 4096 bytes Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: detected max file descriptor number: 2048 Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: lock engine: pthread robust mutexes Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: thunder lock: enabled Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 08:43:01.940701 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 08:43:01.976757 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: Python main interpreter initialized at 0x5620040f49c0 Oct 04 08:43:01.976757 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: python threads support enabled Oct 04 08:43:01.976757 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: your server socket listen backlog is limited to 100 connections Oct 04 08:43:01.976757 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: your mercy for graceful operations on workers is 90 seconds Oct 04 08:43:01.977108 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 08:43:01.977175 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: *** Operational MODE: preforking *** Oct 04 08:43:01.977446 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: *** uWSGI is running in multiple interpreter mode *** Oct 04 08:43:01.977446 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: spawned uWSGI master process (pid: 127438) Oct 04 08:43:01.977647 dv-cinder-844563-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 04 08:43:01.978197 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: spawned uWSGI worker 1 (pid: 127439, cores: 1) Oct 04 08:43:01.982661 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: spawned uWSGI worker 2 (pid: 127440, cores: 1) Oct 04 08:43:01.982661 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 08:43:02.630193 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 08:43:02.630816 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 08:43:03.691359 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:43:03.691359 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: from cryptography.utils import int_from_bytes Oct 04 08:43:03.692114 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:43:03.692114 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: from cryptography.utils import int_from_bytes Oct 04 08:43:03.692508 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:43:03.692508 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: from cryptography.utils import int_from_bytes Oct 04 08:43:03.692646 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:43:03.692646 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: from cryptography.utils import int_from_bytes Oct 04 08:43:06.117145 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:43:06.117732 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:43:06.117872 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:43:06.118142 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:43:06.118542 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:43:06.118643 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:43:06.118715 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:43:06.118865 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.119019 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:43:06.119176 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.119288 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:43:06.119447 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.119553 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:43:06.119783 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.119974 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.120154 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.120307 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.120434 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.120538 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.120773 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.120904 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.121086 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.121222 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.121389 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.121531 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.121619 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.121712 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.121932 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.122035 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.122245 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-14-iscsi {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.122335 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.122556 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.122655 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.122855 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.122949 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.123138 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.123241 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-14-iscsi {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.123447 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.123551 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.123742 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.123841 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.124074 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.124176 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.124371 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.124474 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.124674 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.124857 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.125024 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.126035 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.126142 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.126142 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.126297 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.126385 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.126454 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.126533 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.126909 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.126993 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.127061 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.127134 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.127372 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.127477 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.127549 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.127630 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.127860 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.127971 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.128204 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.128313 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.128508 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.128607 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-14-iscsi {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.128824 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.128927 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.129126 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.129216 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.129482 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.129581 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-14-iscsi {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.129810 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.129906 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.130117 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.130207 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.130436 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.130534 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.130742 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.130843 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.131058 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.131148 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.131354 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.131501 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.131669 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.131822 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.132001 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.132142 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.132290 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.132437 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.132581 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.132741 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.132917 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.133062 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.133214 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.133351 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.133488 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.133632 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.133770 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.133906 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.134054 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.134200 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.134344 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.134494 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.134630 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.134766 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.134903 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.135057 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.135194 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.135341 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.135477 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.135613 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.135749 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.135919 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.136081 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.136227 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.136366 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.136503 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.136645 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.136792 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.136941 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.137090 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.137228 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.137367 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.137512 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.137658 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.137795 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.137937 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.138075 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.138218 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.138397 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.138551 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.138689 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.138831 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.138969 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.139113 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.139259 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.139406 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.139544 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.139680 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.139815 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.140017 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.140175 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.140324 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.140460 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.140595 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.140733 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.140868 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.141024 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.141165 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.141301 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.141443 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.141579 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.141714 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.141859 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.142006 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.142142 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.142279 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.142414 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.142549 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.142697 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.142835 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.142978 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.143122 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.143259 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.143441 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.143600 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.143737 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.143915 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.144059 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.144196 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.144345 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.144490 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.144627 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.144770 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.144914 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.145058 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.145209 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.145346 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.145483 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.145626 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.145780 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.145924 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.146070 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.146206 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.146349 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.146494 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.146630 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.146779 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.146916 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.147051 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.147194 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.147330 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.147465 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.147621 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.147758 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.147925 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.148068 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.148269 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.148453 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.148611 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.148749 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.148884 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.149020 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.149163 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.149299 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.149444 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.149601 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.149738 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.149882 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.150017 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.150161 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.150307 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.150452 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.150589 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.150733 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.150868 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.151017 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.151164 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.151322 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.151471 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.151609 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.151753 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.151973 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.152135 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.152281 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.152417 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.152568 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.152707 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.152843 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.153043 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.153193 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.153353 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.153490 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.153625 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.153762 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.153973 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.154121 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.154258 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.154393 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.154539 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.154684 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.154830 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.154979 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.155124 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.155271 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.155407 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.155551 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.155696 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.155845 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.156021 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.156168 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.156313 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.156458 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.156595 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.156731 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.156866 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.157018 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.157164 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.157313 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.157449 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.157587 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.157727 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.157880 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.158027 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.158173 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.158309 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.158444 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.158580 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.158715 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.158859 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.159007 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.159143 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.159278 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.159413 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.159548 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.159697 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.159834 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.159997 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.160134 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.160269 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.160405 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.160559 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.160713 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.160850 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.160986 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.161164 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:06.161314 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.161461 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.161638 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.161777 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.161913 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.162047 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.162193 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.162330 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.162474 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.162633 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.162784 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.162945 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.163101 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.163250 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.163396 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.163534 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.163672 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.163816 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.164024 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.164024 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.164304 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.164450 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.164621 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.164791 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.164941 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.165079 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.165215 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.165360 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.165495 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.165645 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.165783 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.165926 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.166064 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.166208 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.166368 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.166515 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.166659 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.166795 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.166931 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.167075 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.167212 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.167357 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.167507 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.167656 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.167799 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.167995 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.168148 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.168294 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.168440 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.168577 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.168712 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.168849 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.168993 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.169167 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.169317 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.169498 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.169649 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.169793 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.169939 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.170095 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.170232 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.170368 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.170505 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.170651 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.170800 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.170961 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.171115 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.171260 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.171396 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.171540 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.171690 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.171827 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.172004 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.172143 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.172280 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.172416 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.172564 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.172775 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.172979 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.173129 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.173270 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.173428 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.173567 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.173707 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.173853 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.174006 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.174143 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.174290 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.174427 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.174564 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.174701 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.174838 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.174974 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.175191 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.175331 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.175469 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.175605 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.175742 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.175922 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.176081 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.176219 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.176355 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.176491 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.176635 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.176781 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.176935 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.177078 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.177224 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.177369 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.177506 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.177652 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.177804 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.177943 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.178079 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.178215 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.178360 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.178506 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.178652 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.178797 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.178935 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.179084 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.179221 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.179367 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.179579 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.179727 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.179864 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.180071 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.180226 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.180364 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.180500 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.180636 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.180771 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.180906 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.181052 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.181218 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.181461 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.181615 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.181752 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.181888 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.182034 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.182174 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.182310 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.182446 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.182582 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.182726 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.182876 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.183014 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.183151 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.183294 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.183442 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.183588 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.183726 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.183862 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.184027 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.184165 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.184301 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.184450 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.184587 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.184724 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.184860 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.185024 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.185177 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.185324 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.185462 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.185599 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.185734 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.185883 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.186019 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.186166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.186304 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.186440 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.186577 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.186712 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.186857 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.187017 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.187156 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.187292 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.187509 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.187713 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.187877 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.188085 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.188227 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.188379 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.188529 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.188667 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.188814 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.188959 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.189119 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.189256 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.189392 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.189529 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.189676 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.189813 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.189950 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.190086 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.190231 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.190390 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.190539 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.190677 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.190813 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.190961 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.191099 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.191248 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.191393 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.191541 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.191692 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.191829 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.191996 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.192148 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.192285 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.192421 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.192566 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.192714 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.192850 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.192999 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.193136 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.193272 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.193503 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.193646 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.193793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.193940 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.194078 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.194222 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.194368 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.194505 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.194665 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.194811 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.194955 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.195194 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.195348 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.195494 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.195641 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.195788 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.195965 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.196107 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.196244 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.196379 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.196533 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.196682 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.196820 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.196956 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.197092 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.197235 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.197386 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.197523 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.197667 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.197806 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.197941 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.198085 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.198230 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.198374 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.198529 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.198666 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.198802 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.198948 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.199108 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.199249 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.199393 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.199537 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.199695 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.199847 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.200019 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.200156 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.200305 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.200453 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.200590 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.200739 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.200878 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.201015 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.201194 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.201337 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.201495 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.201633 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.201791 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.201941 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.202080 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.202215 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.202442 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.202590 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.202727 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.202862 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.202999 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.203134 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.203279 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.203417 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.203563 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.203700 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.203867 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.204062 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.204230 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.204369 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.204514 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.204651 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.204797 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.204934 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.205085 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.205224 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.205361 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.205505 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.205648 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.205794 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.205944 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.206094 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.206240 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.206385 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.206521 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.206666 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.206804 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.206949 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.207085 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.207223 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.207368 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.207515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.207651 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.207787 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.207954 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.208096 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.208232 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.208381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.208518 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.208654 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.208789 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.208924 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.209068 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.209205 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.209342 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.209504 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.209646 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.209793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.209943 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.210080 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.210217 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.210379 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.210530 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.210696 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.210847 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.211026 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.211169 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.211344 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.211501 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.211655 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.211812 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.212026 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.212167 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.212303 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.212439 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.212588 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.212725 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.212862 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.212998 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.213135 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.213270 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.213414 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.213563 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.213698 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.213843 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.214037 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.214180 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.214325 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.214461 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.214626 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.214784 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.214921 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.215055 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.215212 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.215356 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.215512 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.215659 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.215802 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.215984 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.216132 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.216282 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.216426 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.216577 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.216721 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.216873 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.217018 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.217160 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.217305 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.217458 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.217601 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.217755 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.217900 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.218051 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.218210 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.218361 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.218504 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.218656 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.218801 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.218952 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.219103 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.219257 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.219410 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.219562 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.219706 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.219937 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.220117 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.220276 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.220430 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.220573 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.220729 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.220875 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.221064 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.221213 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.221368 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.221521 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.221676 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.221819 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.221970 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.222114 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.222263 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.222416 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.222570 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.222728 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.222873 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.223017 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.223161 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.223314 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.223466 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.223610 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.223753 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.223920 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.224072 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.224215 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.224378 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.224523 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.224666 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.224809 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.224952 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.225096 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.225325 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.225480 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.225624 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.225768 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.225911 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.226062 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.226216 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.226359 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.226542 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.226686 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.226836 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.226989 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.227150 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.227294 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.227445 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.227598 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.227741 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.227944 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.228100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.228259 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.228403 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.228546 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.228688 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.228847 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.228999 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.229165 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.229311 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.229454 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.229610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.229755 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.229897 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.230040 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.230190 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.230343 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.230501 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.230661 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.230804 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.230962 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.231118 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.231270 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.231426 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.231569 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.231720 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.231720 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.232027 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.232195 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.232349 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.232495 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.232647 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.232790 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.232949 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.233102 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.233254 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.233397 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.233549 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.233698 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.233841 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.233992 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.234144 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.234304 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.234448 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.234591 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.234734 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.234902 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.235047 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.235189 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.235332 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.235477 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.235620 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.235772 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.235940 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.236109 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.236254 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.236397 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.236550 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.236695 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.236849 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.237001 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.237145 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.237287 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.237441 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.237585 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.237728 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.237871 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.238032 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.238176 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.238328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.238477 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.238621 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.238776 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.238927 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.239071 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.239232 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.239376 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.239524 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.239667 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.239813 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.240028 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.240187 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.240332 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.240476 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.240627 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.240783 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.240936 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.241089 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.241233 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.241376 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.241519 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.241671 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.241824 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.241969 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.242156 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.242313 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.242458 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.242612 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.242765 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.242911 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.243063 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.243207 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.243366 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.243520 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.243664 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.243807 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.243993 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.244140 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.244299 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.244462 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.244617 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.244761 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.244903 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.245047 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.245197 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.245353 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.245506 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.245649 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.245804 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.245946 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.246090 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.246244 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.246388 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.246541 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.246684 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.246829 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.246981 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.247132 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.247275 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.247418 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.247573 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.247715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.247866 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.248040 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.248185 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.248339 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.248499 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.248642 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.248804 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.248948 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.249101 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.249246 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.249396 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.249540 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.249707 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.249865 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.250018 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.250169 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.250314 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.250314 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.250616 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.250616 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.250890 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.251034 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.251177 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.251329 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.251474 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.252004 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.252164 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.252308 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.252452 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.252616 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.252761 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.252905 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.253056 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.253200 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.253351 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.253580 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.253728 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.253872 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.254015 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.254158 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.254301 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.254455 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.254611 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.254737 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.254809 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.254903 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.255011 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.255094 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.255173 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.255250 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.255250 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.255420 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.255507 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.255507 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.255668 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.255756 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.256025 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.256172 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.256336 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.256599 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.256738 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.256984 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.257123 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.257318 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.257647 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.257821 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.258033 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.258346 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.258477 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.258648 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.258866 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.258998 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.259242 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.259372 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.259542 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.259828 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.259948 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.260175 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.260443 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.260532 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.260759 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.260865 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.261060 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.261148 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.261361 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.261450 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.261659 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.261763 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.261952 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.262388 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.262611 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.262700 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.262925 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.263041 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.263234 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.263322 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.263518 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.263610 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.263825 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.263985 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.264154 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.264241 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.264463 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.264578 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.264766 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.264857 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.265061 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.265176 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.265468 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.265561 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.265774 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.265859 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.266078 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.266161 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.266378 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.266470 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.266675 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.266758 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.266973 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.267057 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.267278 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.267371 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.267580 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.267663 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.267904 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.267991 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.268200 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.268298 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.268498 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.268582 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.268803 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.268886 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.269100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.269193 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.269415 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.269520 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.269822 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.269907 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.270125 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.270210 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.270420 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.270541 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.270827 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.270912 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.271128 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.271214 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.271434 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.271529 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.271749 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.271834 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.272084 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.272170 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.272388 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.272473 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.272687 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.272791 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.272994 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.273077 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.273336 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.273436 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.273652 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.273737 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.273959 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.274042 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.274262 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.274347 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.274560 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.274643 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.274863 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.275004 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.275228 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.275324 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.275485 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.275583 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.275789 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.275902 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.276127 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.276236 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.276533 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.276620 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.276849 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.276943 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.277153 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.277250 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.277468 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.277552 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.277768 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.277861 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.278070 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.278165 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.278368 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.278451 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.278670 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.278755 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.278965 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.279048 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.279265 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.279358 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.279575 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.279660 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.279869 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.279987 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.280191 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.280276 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.280493 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.280579 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.280790 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.280881 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.281085 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.281170 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.281380 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.281466 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.281689 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.281772 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.281983 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.282079 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.282295 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.282380 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.282600 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.282684 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.282911 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.283004 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.283210 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.283294 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.283509 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.283593 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.283819 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.283931 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.284140 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.284225 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.284435 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.284527 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.284728 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.284820 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.285026 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.285132 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.285353 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.285447 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.285648 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.285754 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.285958 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.286043 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.286278 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.286362 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.286584 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.286671 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.286888 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.286980 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.287212 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.287297 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.287529 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.287612 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.287838 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.287965 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.288159 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.288263 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.288467 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.288553 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.288766 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.288850 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.289116 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.289216 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.289414 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.289507 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.289713 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.289803 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.290007 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.290100 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.290302 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.290398 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.290596 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.290681 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.290892 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.290989 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.291184 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.291268 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.291481 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.291573 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.291774 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.291859 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.292110 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.292196 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.292405 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.292502 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.292718 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.292805 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.293015 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.293099 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.293308 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.293399 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.293607 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.293698 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.293897 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.293988 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.294228 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.294314 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.294523 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.294609 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.294836 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.294916 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.295138 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.295266 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.295448 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.295559 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.295756 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.296012 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.296106 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.296325 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.296417 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.296634 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.296731 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.296940 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.297031 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.297251 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.297343 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.297558 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.297649 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.297864 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.297957 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.298165 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.298256 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.298470 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.298571 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.298775 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.299023 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.299124 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.299346 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.299616 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.299707 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.299958 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.300065 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.300267 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.300359 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.300573 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.300665 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.300877 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.300979 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.301183 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.301273 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.301490 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.301581 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.301792 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.301891 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.302095 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.302186 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.302398 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.302504 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.302699 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.302801 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.303020 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.303111 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.303335 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.303426 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.303652 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.303744 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.303984 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.304089 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.304329 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.304473 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.304656 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.304799 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.304965 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.305097 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.305303 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.305420 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.305569 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.305677 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.305879 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.305970 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.306178 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.306270 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.306487 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.306578 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.306795 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.306885 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.307100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.307190 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.307404 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.307504 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.307704 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.307856 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.308059 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.308217 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.308375 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.308519 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.308665 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.308817 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.308965 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.309116 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.309270 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.309414 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.309556 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.309709 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.309860 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.310012 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.310174 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.310319 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.310465 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.310617 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.310761 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.310918 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.311063 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.311243 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.311403 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.311555 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.311870 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.312053 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.312200 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.312366 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.312521 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.312665 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.312809 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.312952 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.313123 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.313273 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.313444 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.313589 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.313734 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.313876 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.314019 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.314173 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.314335 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.314481 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.314623 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.314766 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.314909 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.315086 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.315272 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.315420 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.315564 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.315706 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.315849 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.316042 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.316200 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.316356 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.316502 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.316652 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.316805 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.316963 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.317107 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.317260 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.317451 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.317601 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.317789 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.317949 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.318094 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.318249 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.318419 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.318573 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.318726 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.318871 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.319014 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.319157 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.319309 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.319467 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.319620 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.319773 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.319940 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.320132 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.320296 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.320440 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.320599 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.320753 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.320895 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.321038 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.321182 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.321333 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.321562 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.321710 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.321860 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.322004 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.322166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.322320 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.322464 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.322610 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.322753 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.322904 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.323056 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.323209 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.323353 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.323496 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.323641 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.323784 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.323964 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.324135 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.324281 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.324431 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.324575 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.324720 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.324871 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.325024 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.325169 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.325312 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.325463 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.325607 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.325760 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.325913 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.326068 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.326221 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.326368 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.326510 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.326663 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.326809 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.326952 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.326952 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.327232 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.327232 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.327521 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.327666 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.327818 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.327996 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.328141 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.328295 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.328449 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.328594 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.328746 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.328746 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.329019 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.329172 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.329333 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.329487 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.329632 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.329794 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.329941 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.330093 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.330238 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.330381 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.330525 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.330668 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.330811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.330964 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.331109 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.331261 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.331406 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.331549 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.331703 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.331856 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.332069 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.332223 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.332368 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.332512 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.332665 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.332817 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.332961 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.333106 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.333249 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.333391 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.333544 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.333699 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.333844 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.333989 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.334132 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.334275 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.334428 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.334572 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.334716 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.334858 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.335001 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.335144 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.335302 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.335461 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.335606 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.335771 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.335939 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.336100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.336260 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.336404 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.336549 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.336699 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.336844 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.336997 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.337142 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.337285 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.337444 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.337588 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.337731 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.337884 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.338028 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.338172 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.338318 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.338461 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.338613 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.338766 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.338910 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.339053 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.339206 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.339358 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.339514 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.339658 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.339802 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.339970 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.340116 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.340259 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.340416 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.340568 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.340711 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.340862 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.341007 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.341170 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.341323 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.341470 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.341615 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.341759 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.341902 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.342056 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.342382 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.342533 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.342707 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.342857 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.343031 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.343198 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.343344 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.343496 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.343642 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.343785 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.343997 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.344156 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.344300 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.344445 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.344590 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.344733 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.344886 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.345049 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.345194 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.345337 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.345481 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.345624 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.345777 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.345922 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.346066 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.346209 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.346352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.346504 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.346650 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.346804 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.346948 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.347099 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.347245 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.347401 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.347553 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.347705 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.347850 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.348022 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.348167 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.348323 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.348468 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.348612 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.348766 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.348911 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.349063 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.349282 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.349431 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.349583 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.349728 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.349872 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.350025 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.350169 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.350313 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.350456 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.350600 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.350756 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.350911 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.351055 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.351199 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.351365 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.351546 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.351691 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.351845 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.352028 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.352173 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.352317 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.352463 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.352612 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.352778 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.352924 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.353069 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.353219 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.353364 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.353521 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.353666 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.353809 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.353952 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.354096 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.354239 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.354397 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.354542 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.354697 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.354842 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.354985 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.355130 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.355282 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.355443 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.355588 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.355733 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.355867 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.356090 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.356194 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.356276 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.356359 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.356446 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.356526 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.356612 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.356843 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.356976 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.357156 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.357288 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.357462 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.357607 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.357789 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.357921 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.358096 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.358236 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.358364 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.358494 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.358692 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.358824 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.358997 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.359129 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.359269 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.359389 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.359593 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.359723 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.359911 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.360040 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.360222 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.360354 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.360523 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.360614 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.360824 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.360913 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.361133 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.361224 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.361445 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.361533 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.361745 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.361844 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.362052 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.362140 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.362350 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.362447 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.362650 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.362748 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.362947 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.363036 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.363247 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.363345 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.363547 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.363645 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.363850 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.363979 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.364171 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.364259 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.364470 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.364560 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.364764 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.364849 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.365069 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.365155 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.365375 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.365460 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.365691 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.365775 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.365991 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.366095 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.366308 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.366404 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.366622 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.366708 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.366941 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.367035 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.367299 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.367386 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.367610 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.367695 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.367958 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.368061 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.368268 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.368361 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.368571 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.368655 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.368868 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.368961 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.369105 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:43:06.369191 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:06.369392 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:43:06.522330 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO dbcounter [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] Registered counter for database nova_api Oct 04 08:43:06.522524 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO dbcounter [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] Registered counter for database nova_api Oct 04 08:43:06.543913 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_db.sqlalchemy.engines [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:06.545924 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG oslo_db.sqlalchemy.engines [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:06.550489 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG dbcounter [-] [127439] Writer thread running {{(pid=127439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:06.553771 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG dbcounter [-] [127440] Writer thread running {{(pid=127440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:06.607489 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.context [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),741e120e-a520-4525-9dbb-b6709af0a52b(cell1) {{(pid=127439) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 08:43:06.611392 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:06.611538 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.context [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),741e120e-a520-4525-9dbb-b6709af0a52b(cell1) {{(pid=127440) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 08:43:06.611852 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:06.613419 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:06.614105 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:06.614543 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:06.615308 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG oslo_concurrency.lockutils [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:06.615780 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG oslo_concurrency.lockutils [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:06.617575 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:06.617690 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG oslo_concurrency.lockutils [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:06.618131 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG oslo_concurrency.lockutils [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:06.618576 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG oslo_concurrency.lockutils [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:06.618769 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO dbcounter [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] Registered counter for database nova_cell0 Oct 04 08:43:06.620590 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG oslo_concurrency.lockutils [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:06.622642 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO dbcounter [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] Registered counter for database nova_cell0 Oct 04 08:43:06.622953 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO dbcounter [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] Registered counter for database nova_cell1 Oct 04 08:43:06.627262 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO dbcounter [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] Registered counter for database nova_cell1 Oct 04 08:43:06.631074 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_db.sqlalchemy.engines [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:06.632861 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_db.sqlalchemy.engines [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:06.634514 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG oslo_db.sqlalchemy.engines [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:06.635951 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG oslo_db.sqlalchemy.engines [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:06.637788 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG dbcounter [-] [127439] Writer thread running {{(pid=127439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:06.642485 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG dbcounter [-] [127440] Writer thread running {{(pid=127440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:06.644740 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG dbcounter [-] [127440] Writer thread running {{(pid=127440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:06.774112 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG dbcounter [-] [127439] Writer thread running {{(pid=127439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:06.784111 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO dbcounter [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] Registered counter for database nova_cell0 Oct 04 08:43:06.787797 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO dbcounter [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] Registered counter for database nova_cell0 Oct 04 08:43:06.791506 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_db.sqlalchemy.engines [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:06.797035 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG dbcounter [-] [127439] Writer thread running {{(pid=127439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:06.797490 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG oslo_db.sqlalchemy.engines [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:06.802804 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG dbcounter [-] [127440] Writer thread running {{(pid=127440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:07.129525 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: WARNING keystonemiddleware.auth_token [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:43:07.131015 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: WARNING keystonemiddleware.auth_token [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:43:07.136823 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: WARNING keystonemiddleware.auth_token [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:43:07.138356 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: WARNING keystonemiddleware.auth_token [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:43:07.478366 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: WARNING keystonemiddleware.auth_token [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:43:07.479316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: WARNING keystonemiddleware.auth_token [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:43:07.484282 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: WARNING keystonemiddleware.auth_token [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:43:07.485270 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: WARNING keystonemiddleware.auth_token [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:43:07.489543 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5620040f49c0 pid: 127440 (default app) Oct 04 08:43:07.490621 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5620040f49c0 pid: 127439 (default app) Oct 04 08:43:07.491988 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:43:07.493137 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-812f4ee1-2529-4035-bb93-d8163ccb014a None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002064 Oct 04 08:43:07.493553 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Tue Oct 4 08:43:07 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:28.894712 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:28.896041 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002063 Oct 04 08:44:28.896460 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 931 bytes} [Tue Oct 4 08:44:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:28.908155 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG dbcounter [-] [127440] Writing DB stats nova_api:SELECT=3 {{(pid=127440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:28.909226 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG dbcounter [-] [127440] Writing DB stats nova_cell0:SELECT=3 {{(pid=127440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:28.911466 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG dbcounter [-] [127440] Writing DB stats nova_cell1:SELECT=3 {{(pid=127440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:28.912492 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG dbcounter [-] [127440] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=127440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:29.761431 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-cd83fa24-d78e-4444-9876-ef36a0753e5c admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:29.794592 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-cd83fa24-d78e-4444-9876-ef36a0753e5c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.891691 Oct 04 08:44:29.795925 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 2/3] 10.222.0.44 () {60 vars in 1292 bytes} [Tue Oct 4 08:44:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:44:32.384451 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:32.385498 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-6d60a8a7-c6bb-4cfa-9c74-f2ed0976f4f6 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Oct 04 08:44:32.386195 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 2/4] 10.222.0.44 () {54 vars in 931 bytes} [Tue Oct 4 08:44:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:32.848176 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-8977843e-7240-403c-981c-4bd462a1b238 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "disk": 1, "id": "c1", "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256}} {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:32.895161 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-8977843e-7240-403c-981c-4bd462a1b238 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.502802 Oct 04 08:44:32.895767 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 3/5] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Oct 4 08:44:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:32.910034 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG dbcounter [-] [127439] Writing DB stats nova_api:SELECT=3 {{(pid=127439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:32.910852 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG dbcounter [-] [127439] Writing DB stats nova_cell0:SELECT=3 {{(pid=127439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:32.912842 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG dbcounter [-] [127439] Writing DB stats nova_cell1:SELECT=3 {{(pid=127439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:32.913607 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG dbcounter [-] [127439] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=127439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:33.115113 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-9afdaae5-2946-4f88-90db-5d397e4944a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:33.184908 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-9afdaae5-2946-4f88-90db-5d397e4944a6 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280033 Oct 04 08:44:33.185563 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 3/6] 10.222.0.44 () {64 vars in 1336 bytes} [Tue Oct 4 08:44:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:44:35.782559 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-8977843e-7240-403c-981c-4bd462a1b238 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:35.783583 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-8977843e-7240-403c-981c-4bd462a1b238 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 04 08:44:35.783984 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 4/7] 10.222.0.44 () {54 vars in 931 bytes} [Tue Oct 4 08:44:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:36.440908 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-c134b76e-b371-401c-94fa-3733a4cb42d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "name": "ds512M"}} {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:36.479540 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-c134b76e-b371-401c-94fa-3733a4cb42d8 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.689345 Oct 04 08:44:36.480332 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 4/8] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Oct 4 08:44:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 08:44:36.492241 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-0a4e87e5-c77d-4271-b58b-f02cecf0341b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:36.536762 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-0a4e87e5-c77d-4271-b58b-f02cecf0341b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048081 Oct 04 08:44:36.537355 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 5/9] 10.222.0.44 () {64 vars in 1336 bytes} [Tue Oct 4 08:44:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:44:39.166628 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-c134b76e-b371-401c-94fa-3733a4cb42d8 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:39.167687 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-c134b76e-b371-401c-94fa-3733a4cb42d8 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Oct 04 08:44:39.168116 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 931 bytes} [Tue Oct 4 08:44:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:39.578541 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-77b079ba-b2ba-42c2-bc3a-7400d906d892 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:39.599723 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-77b079ba-b2ba-42c2-bc3a-7400d906d892 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.424455 Oct 04 08:44:39.600700 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 6/11] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Oct 4 08:44:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:39.614118 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-d601d0da-4442-4d9a-9d88-5f136b24a8a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:39.643344 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-d601d0da-4442-4d9a-9d88-5f136b24a8a3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033226 Oct 04 08:44:39.643951 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 6/12] 10.222.0.44 () {64 vars in 1336 bytes} [Tue Oct 4 08:44:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:44:42.249764 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-77b079ba-b2ba-42c2-bc3a-7400d906d892 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:42.250718 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-77b079ba-b2ba-42c2-bc3a-7400d906d892 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 04 08:44:42.251089 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 7/13] 10.222.0.44 () {54 vars in 931 bytes} [Tue Oct 4 08:44:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:42.679115 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-863adc89-0f68-4a4f-b4fe-1716845b0281 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0}} {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:42.700243 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-863adc89-0f68-4a4f-b4fe-1716845b0281 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442155 Oct 04 08:44:42.700939 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 7/14] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Oct 4 08:44:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 08:44:42.713711 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-4844a172-35a9-4449-ae3a-c7d1fe4e42a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:42.743277 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-4844a172-35a9-4449-ae3a-c7d1fe4e42a8 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033437 Oct 04 08:44:42.744039 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 8/15] 10.222.0.44 () {64 vars in 1336 bytes} [Tue Oct 4 08:44:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:44:45.357471 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-863adc89-0f68-4a4f-b4fe-1716845b0281 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:45.358407 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-863adc89-0f68-4a4f-b4fe-1716845b0281 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 04 08:44:45.358815 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 8/16] 10.222.0.44 () {54 vars in 931 bytes} [Tue Oct 4 08:44:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:45.788358 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-0925b1d9-1629-4f72-84d6-ff2e97e94ef4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "d4", "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:45.810113 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-0925b1d9-1629-4f72-84d6-ff2e97e94ef4 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444926 Oct 04 08:44:45.810861 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 9/17] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Oct 4 08:44:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:45.824438 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-6b3bc0f9-652d-4ee2-97b6-8c9631c10fc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:45.853135 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-6b3bc0f9-652d-4ee2-97b6-8c9631c10fc7 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033621 Oct 04 08:44:45.853735 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 9/18] 10.222.0.44 () {64 vars in 1336 bytes} [Tue Oct 4 08:44:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:44:48.447904 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-0925b1d9-1629-4f72-84d6-ff2e97e94ef4 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:48.449235 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-0925b1d9-1629-4f72-84d6-ff2e97e94ef4 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001845 Oct 04 08:44:48.449780 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 10/19] 10.222.0.44 () {54 vars in 931 bytes} [Tue Oct 4 08:44:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:48.874969 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-0eaf1f2d-966c-4de4-89ef-b05653b73ff7 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:48.905622 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-0eaf1f2d-966c-4de4-89ef-b05653b73ff7 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447875 Oct 04 08:44:48.906305 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 10/20] 10.222.0.44 () {60 vars in 1292 bytes} [Tue Oct 4 08:44:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:44:51.735792 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-0925b1d9-1629-4f72-84d6-ff2e97e94ef4 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:51.736822 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-0925b1d9-1629-4f72-84d6-ff2e97e94ef4 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Oct 04 08:44:51.737219 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 11/21] 10.222.0.44 () {54 vars in 931 bytes} [Tue Oct 4 08:44:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:52.140044 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-c97ebd35-bac3-4724-91e1-cc3ffa722592 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "name": "m1.tiny"}} {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:52.162117 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-c97ebd35-bac3-4724-91e1-cc3ffa722592 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.418598 Oct 04 08:44:52.162753 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 11/22] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Oct 4 08:44:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:52.175679 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-4c868c68-885e-4d97-a8d8-532b9a46d80f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:52.204720 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-4c868c68-885e-4d97-a8d8-532b9a46d80f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033201 Oct 04 08:44:52.205299 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 12/23] 10.222.0.44 () {64 vars in 1333 bytes} [Tue Oct 4 08:44:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:44:54.777500 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-c97ebd35-bac3-4724-91e1-cc3ffa722592 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:54.778514 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-c97ebd35-bac3-4724-91e1-cc3ffa722592 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 04 08:44:54.778907 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 12/24] 10.222.0.44 () {54 vars in 931 bytes} [Tue Oct 4 08:44:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:44:55.159645 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-901aeedd-1d36-4dab-a612-24e56d811fdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "swap": 0}} {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:55.180430 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-901aeedd-1d36-4dab-a612-24e56d811fdc admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.394939 Oct 04 08:44:55.181089 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 13/25] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Oct 4 08:44:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:55.193552 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-c310bfd6-1ed0-47f5-9ca0-967775d4931b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:55.218057 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-c310bfd6-1ed0-47f5-9ca0-967775d4931b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028414 Oct 04 08:44:55.218637 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 13/26] 10.222.0.44 () {64 vars in 1333 bytes} [Tue Oct 4 08:44:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:44:57.827699 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-901aeedd-1d36-4dab-a612-24e56d811fdc admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:57.828752 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-901aeedd-1d36-4dab-a612-24e56d811fdc admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Oct 04 08:44:57.829706 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 14/27] 10.222.0.44 () {54 vars in 931 bytes} [Tue Oct 4 08:44:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:58.269228 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-7b828c3f-4f9c-46db-9b61-c4b7a42b9239 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "vcpus": 2, "swap": 0}} {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:58.291104 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-7b828c3f-4f9c-46db-9b61-c4b7a42b9239 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.455557 Oct 04 08:44:58.291817 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 14/28] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Oct 4 08:44:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:58.306071 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-19b6811a-4efa-46f6-af92-1ca8a8a3b1f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:58.333207 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-19b6811a-4efa-46f6-af92-1ca8a8a3b1f3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031007 Oct 04 08:44:58.334120 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 15/29] 10.222.0.44 () {64 vars in 1333 bytes} [Tue Oct 4 08:44:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:45:01.088593 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-7b828c3f-4f9c-46db-9b61-c4b7a42b9239 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:01.089646 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-7b828c3f-4f9c-46db-9b61-c4b7a42b9239 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Oct 04 08:45:01.090319 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 15/30] 10.222.0.44 () {54 vars in 931 bytes} [Tue Oct 4 08:45:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:01.593050 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-6f96a697-9306-4ee9-87cf-6afeb3440d9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "swap": 0, "id": "4", "disk": 80, "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:01.599304 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG dbcounter [-] [127440] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=127440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:01.617234 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-6f96a697-9306-4ee9-87cf-6afeb3440d9d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.521041 Oct 04 08:45:01.618019 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 16/31] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Oct 4 08:45:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:01.630646 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-1589c2af-8c82-480b-ab57-c4afca18c2f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:01.655021 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-1589c2af-8c82-480b-ab57-c4afca18c2f5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028392 Oct 04 08:45:01.656102 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 16/32] 10.222.0.44 () {64 vars in 1333 bytes} [Tue Oct 4 08:45:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:45:04.342157 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-6f96a697-9306-4ee9-87cf-6afeb3440d9d admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:04.343094 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-6f96a697-9306-4ee9-87cf-6afeb3440d9d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 04 08:45:04.343780 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 17/33] 10.222.0.44 () {54 vars in 931 bytes} [Tue Oct 4 08:45:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:04.783033 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-98dcad58-f992-4e9f-8d1c-93c80dec2313 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "id": "5", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8}} {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:04.790771 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG dbcounter [-] [127439] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=127439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:04.806402 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-98dcad58-f992-4e9f-8d1c-93c80dec2313 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.456426 Oct 04 08:45:04.807218 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 17/34] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Oct 4 08:45:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 08:45:04.819764 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-8d1fa38f-f8bf-45e5-904f-92471be9eb41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:04.846888 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-8d1fa38f-f8bf-45e5-904f-92471be9eb41 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031254 Oct 04 08:45:04.847745 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 18/35] 10.222.0.44 () {64 vars in 1333 bytes} [Tue Oct 4 08:45:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:45:21.173108 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-98dcad58-f992-4e9f-8d1c-93c80dec2313 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:21.174107 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-98dcad58-f992-4e9f-8d1c-93c80dec2313 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Oct 04 08:45:21.174506 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 18/36] 10.222.0.44 () {54 vars in 931 bytes} [Tue Oct 4 08:45:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:21.191470 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG dbcounter [-] [127440] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=127440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:21.612198 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-1f79d97c-b030-449c-9f04-15cc83ed4913 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:21.631304 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-1f79d97c-b030-449c-9f04-15cc83ed4913 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.447148 Oct 04 08:45:21.631766 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 19/37] 10.222.0.44 () {60 vars in 1292 bytes} [Tue Oct 4 08:45:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:45:22.956545 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-98dcad58-f992-4e9f-8d1c-93c80dec2313 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:22.957556 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-98dcad58-f992-4e9f-8d1c-93c80dec2313 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 04 08:45:22.957986 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 19/38] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:23.516112 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-29afefca-8322-40df-b06e-7bb9feec4714 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:23.521652 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.wsgi [None req-29afefca-8322-40df-b06e-7bb9feec4714 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-29afefca-8322-40df-b06e-7bb9feec4714 admin admin] Request method failure captured: Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Accept: application/json Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Accept-Encoding: gzip, deflate Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Connection: keep-alive Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Content-Length: 0 Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Host: 10.222.0.44 Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Openstack-Api-Version: compute 2.92 Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Openstack-System-Scope: None Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: User-Agent: python-novaclient Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Auth-Token: gAAAAABjO_KiR3Csuv2Vgzwr8veCDJ98UFiD9aRMbRhuGPIrki82SP2Gi5lkNj8XAalEGuwfNyBhU-R0H8xLkKSEPvzAn_KveuYz9gY55eP4hcwhsKv1HBaTZWW7Jn0vyCzqaEp-YZ_Mcz7lvMd8PL3aH5Ev375JGuutOZaITxnEUk6s7jua27E Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Domain-Id: None Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Domain-Name: None Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Identity-Status: Confirmed Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Is-Admin-Project: True Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Project-Domain-Id: default Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Project-Domain-Name: Default Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Project-Id: 5d6b22621efa4e2c8d25ad2792cb5242 Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Project-Name: admin Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Role: member,reader,admin Oct 04 08:45:23.525002 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Roles: member,reader,admin Oct 04 08:45:23.526675 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5d6b22621efa4e2c8d25ad2792cb5242", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:45:23.526675 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Tenant: admin Oct 04 08:45:23.526675 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Tenant-Id: 5d6b22621efa4e2c8d25ad2792cb5242 Oct 04 08:45:23.526675 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Tenant-Name: admin Oct 04 08:45:23.526675 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-User: admin Oct 04 08:45:23.526675 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-User-Domain-Id: default Oct 04 08:45:23.526675 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-User-Domain-Name: Default Oct 04 08:45:23.526675 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-User-Id: 6a7ff5148f6b41108f35cb9aa85b66e2 Oct 04 08:45:23.526675 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-User-Name: admin Oct 04 08:45:23.526675 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: method: > Oct 04 08:45:23.526675 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: exception: Flavor 42 could not be found. Oct 04 08:45:23.526675 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: action_args: {'id': '42'} Oct 04 08:45:23.526675 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:23.526675 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:23.527654 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Oct 04 08:45:23.529100 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-29afefca-8322-40df-b06e-7bb9feec4714 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=127440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:23.530398 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-29afefca-8322-40df-b06e-7bb9feec4714 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.433302 Oct 04 08:45:23.530398 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 20/39] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Oct 4 08:45:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:23.536756 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-f7a3c11f-570a-4a25-b56a-e033ee5c5b43 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:23.558777 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-f7a3c11f-570a-4a25-b56a-e033ee5c5b43 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025963 Oct 04 08:45:23.559221 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 20/40] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Oct 4 08:45:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:45:23.570072 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-1e7a91fc-b0f2-4747-bc50-a9fa5ee397f4 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:23.592362 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-1e7a91fc-b0f2-4747-bc50-a9fa5ee397f4 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026912 Oct 04 08:45:23.592920 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 21/41] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Oct 4 08:45:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:45:23.603212 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-6614eb29-2187-4d54-bdc3-e473f3cb6df2 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:23.609004 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.wsgi [None req-6614eb29-2187-4d54-bdc3-e473f3cb6df2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-6614eb29-2187-4d54-bdc3-e473f3cb6df2 admin admin] Request method failure captured: Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Accept: application/json Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Accept-Encoding: gzip, deflate Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Connection: keep-alive Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Content-Length: 0 Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Host: 10.222.0.44 Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Openstack-Api-Version: compute 2.92 Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Openstack-System-Scope: None Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: User-Agent: python-novaclient Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Auth-Token: gAAAAABjO_KiR3Csuv2Vgzwr8veCDJ98UFiD9aRMbRhuGPIrki82SP2Gi5lkNj8XAalEGuwfNyBhU-R0H8xLkKSEPvzAn_KveuYz9gY55eP4hcwhsKv1HBaTZWW7Jn0vyCzqaEp-YZ_Mcz7lvMd8PL3aH5Ev375JGuutOZaITxnEUk6s7jua27E Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Domain-Id: None Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Domain-Name: None Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Identity-Status: Confirmed Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Is-Admin-Project: True Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Project-Domain-Id: default Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Project-Domain-Name: Default Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Project-Id: 5d6b22621efa4e2c8d25ad2792cb5242 Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Project-Name: admin Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Role: member,reader,admin Oct 04 08:45:23.612316 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Roles: member,reader,admin Oct 04 08:45:23.613743 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5d6b22621efa4e2c8d25ad2792cb5242", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:45:23.613743 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Tenant: admin Oct 04 08:45:23.613743 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Tenant-Id: 5d6b22621efa4e2c8d25ad2792cb5242 Oct 04 08:45:23.613743 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Tenant-Name: admin Oct 04 08:45:23.613743 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-User: admin Oct 04 08:45:23.613743 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-User-Domain-Id: default Oct 04 08:45:23.613743 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-User-Domain-Name: Default Oct 04 08:45:23.613743 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-User-Id: 6a7ff5148f6b41108f35cb9aa85b66e2 Oct 04 08:45:23.613743 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-User-Name: admin Oct 04 08:45:23.613743 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: method: > Oct 04 08:45:23.613743 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: exception: Flavor 42 could not be found. Oct 04 08:45:23.613743 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: action_args: {'id': '42'} Oct 04 08:45:23.613743 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:23.613743 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:23.614811 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Oct 04 08:45:23.616093 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-6614eb29-2187-4d54-bdc3-e473f3cb6df2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=127439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:23.617406 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-6614eb29-2187-4d54-bdc3-e473f3cb6df2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014300 Oct 04 08:45:23.617406 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 21/42] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Oct 4 08:45:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:24.855429 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-1e7a91fc-b0f2-4747-bc50-a9fa5ee397f4 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:24.856509 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-1e7a91fc-b0f2-4747-bc50-a9fa5ee397f4 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Oct 04 08:45:24.856905 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 22/43] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:25.435794 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-9569b144-cee7-40ad-856d-ab8cfe7ba17a admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:25.442883 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.wsgi [None req-9569b144-cee7-40ad-856d-ab8cfe7ba17a admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-9569b144-cee7-40ad-856d-ab8cfe7ba17a admin admin] Request method failure captured: Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Accept: application/json Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Accept-Encoding: gzip, deflate Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Connection: keep-alive Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Content-Length: 0 Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Host: 10.222.0.44 Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Openstack-Api-Version: compute 2.92 Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Openstack-System-Scope: None Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: User-Agent: python-novaclient Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Auth-Token: gAAAAABjO_KkcomIEoeoCQxMa1zLFTF8T-rKx0fwXdaaQZh_BvSJolQDUVo7AidHPAIzv4ZhHykjIj3D3a_-YHLUOnuFiEedT9tIvpgA5biFM85s2inNSyMbuyep5T4hE0hCzuK6S1Vj0a71Dg6Ug8TsmU2Zu4mdYZkYxtZqlcpQexWXa4ADcO8 Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Domain-Id: None Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Domain-Name: None Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Identity-Status: Confirmed Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Is-Admin-Project: True Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Project-Domain-Id: default Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Project-Domain-Name: Default Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Project-Id: 5d6b22621efa4e2c8d25ad2792cb5242 Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Project-Name: admin Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Role: member,reader,admin Oct 04 08:45:25.445328 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Roles: member,reader,admin Oct 04 08:45:25.447833 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5d6b22621efa4e2c8d25ad2792cb5242", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:45:25.447833 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Tenant: admin Oct 04 08:45:25.447833 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Tenant-Id: 5d6b22621efa4e2c8d25ad2792cb5242 Oct 04 08:45:25.447833 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Tenant-Name: admin Oct 04 08:45:25.447833 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-User: admin Oct 04 08:45:25.447833 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-User-Domain-Id: default Oct 04 08:45:25.447833 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-User-Domain-Name: Default Oct 04 08:45:25.447833 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-User-Id: 6a7ff5148f6b41108f35cb9aa85b66e2 Oct 04 08:45:25.447833 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-User-Name: admin Oct 04 08:45:25.447833 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: method: > Oct 04 08:45:25.447833 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: exception: Flavor 84 could not be found. Oct 04 08:45:25.447833 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: action_args: {'id': '84'} Oct 04 08:45:25.447833 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:25.447833 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:25.449515 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Oct 04 08:45:25.451715 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-9569b144-cee7-40ad-856d-ab8cfe7ba17a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=127439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:25.453800 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-9569b144-cee7-40ad-856d-ab8cfe7ba17a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.451693 Oct 04 08:45:25.453800 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 22/44] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Oct 4 08:45:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 453 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:25.460986 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-c2a4c731-32cb-4031-b82e-608bfa54544c admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:25.476252 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-c2a4c731-32cb-4031-b82e-608bfa54544c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019099 Oct 04 08:45:25.476786 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 23/45] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Oct 4 08:45:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:45:25.486310 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-e1247e99-5f9b-4f90-8adc-7e637fa13095 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:25.502212 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-e1247e99-5f9b-4f90-8adc-7e637fa13095 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019501 Oct 04 08:45:25.502742 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 23/46] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Oct 4 08:45:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:45:25.512350 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-6c16d093-a055-4182-aca1-92e9c2bb7157 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:25.517664 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.wsgi [None req-6c16d093-a055-4182-aca1-92e9c2bb7157 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-6c16d093-a055-4182-aca1-92e9c2bb7157 admin admin] Request method failure captured: Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Accept: application/json Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Accept-Encoding: gzip, deflate Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Connection: keep-alive Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Content-Length: 0 Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Host: 10.222.0.44 Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Openstack-Api-Version: compute 2.92 Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Openstack-System-Scope: None Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: User-Agent: python-novaclient Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Auth-Token: gAAAAABjO_KkcomIEoeoCQxMa1zLFTF8T-rKx0fwXdaaQZh_BvSJolQDUVo7AidHPAIzv4ZhHykjIj3D3a_-YHLUOnuFiEedT9tIvpgA5biFM85s2inNSyMbuyep5T4hE0hCzuK6S1Vj0a71Dg6Ug8TsmU2Zu4mdYZkYxtZqlcpQexWXa4ADcO8 Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Domain-Id: None Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Domain-Name: None Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Identity-Status: Confirmed Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Is-Admin-Project: True Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Project-Domain-Id: default Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Project-Domain-Name: Default Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Project-Id: 5d6b22621efa4e2c8d25ad2792cb5242 Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Project-Name: admin Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Role: member,reader,admin Oct 04 08:45:25.519166 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Roles: member,reader,admin Oct 04 08:45:25.520725 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5d6b22621efa4e2c8d25ad2792cb5242", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:45:25.520725 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Tenant: admin Oct 04 08:45:25.520725 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Tenant-Id: 5d6b22621efa4e2c8d25ad2792cb5242 Oct 04 08:45:25.520725 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Tenant-Name: admin Oct 04 08:45:25.520725 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-User: admin Oct 04 08:45:25.520725 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-User-Domain-Id: default Oct 04 08:45:25.520725 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-User-Domain-Name: Default Oct 04 08:45:25.520725 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-User-Id: 6a7ff5148f6b41108f35cb9aa85b66e2 Oct 04 08:45:25.520725 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-User-Name: admin Oct 04 08:45:25.520725 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: method: > Oct 04 08:45:25.520725 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: exception: Flavor 84 could not be found. Oct 04 08:45:25.520725 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: action_args: {'id': '84'} Oct 04 08:45:25.520725 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:25.520725 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:25.521525 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Oct 04 08:45:25.522610 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-6c16d093-a055-4182-aca1-92e9c2bb7157 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=127440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:25.523634 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-6c16d093-a055-4182-aca1-92e9c2bb7157 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011754 Oct 04 08:45:25.523634 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 24/47] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Oct 4 08:45:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:26.754273 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-e1247e99-5f9b-4f90-8adc-7e637fa13095 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:26.755416 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-e1247e99-5f9b-4f90-8adc-7e637fa13095 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Oct 04 08:45:26.755910 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 24/48] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:27.330709 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-573524ee-8f6b-4630-a271-fca0bf38ec79 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:27.336849 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.wsgi [None req-573524ee-8f6b-4630-a271-fca0bf38ec79 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-573524ee-8f6b-4630-a271-fca0bf38ec79 admin admin] Request method failure captured: Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Accept: application/json Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Accept-Encoding: gzip, deflate Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Connection: keep-alive Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Content-Length: 0 Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Host: 10.222.0.44 Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Openstack-Api-Version: compute 2.92 Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Openstack-System-Scope: None Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: User-Agent: python-novaclient Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Auth-Token: gAAAAABjO_KmLVazBgChigPbXyK5_Qc5zejy--QL_DltmgNyUoCzULqDMDLCpPHykroebsbPkioEYcJ7el8RstKZUVrMGQf2i2QcteGQtHRA0pQffk8h4ehNEUPZAfuj8cYN5Qi0H2ojQE5REJMLy2VP4e5QKk-xRj3tZz92mgOA0rDS0thK31g Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Domain-Id: None Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Domain-Name: None Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Identity-Status: Confirmed Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Is-Admin-Project: True Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Project-Domain-Id: default Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Project-Domain-Name: Default Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Project-Id: 5d6b22621efa4e2c8d25ad2792cb5242 Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Project-Name: admin Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Role: member,reader,admin Oct 04 08:45:27.338352 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Roles: member,reader,admin Oct 04 08:45:27.339981 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5d6b22621efa4e2c8d25ad2792cb5242", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:45:27.339981 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Tenant: admin Oct 04 08:45:27.339981 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Tenant-Id: 5d6b22621efa4e2c8d25ad2792cb5242 Oct 04 08:45:27.339981 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-Tenant-Name: admin Oct 04 08:45:27.339981 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-User: admin Oct 04 08:45:27.339981 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-User-Domain-Id: default Oct 04 08:45:27.339981 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-User-Domain-Name: Default Oct 04 08:45:27.339981 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-User-Id: 6a7ff5148f6b41108f35cb9aa85b66e2 Oct 04 08:45:27.339981 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: X-User-Name: admin Oct 04 08:45:27.339981 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: method: > Oct 04 08:45:27.339981 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: exception: Flavor 451 could not be found. Oct 04 08:45:27.339981 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: action_args: {'id': '451'} Oct 04 08:45:27.339981 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:27.339981 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:27.340953 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: ERROR nova.api.openstack.wsgi Oct 04 08:45:27.342055 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-573524ee-8f6b-4630-a271-fca0bf38ec79 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=127440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:27.343116 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-573524ee-8f6b-4630-a271-fca0bf38ec79 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.447490 Oct 04 08:45:27.343116 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 25/49] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Oct 4 08:45:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:27.351089 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-66363111-823b-4f55-b61b-5b1ee7a49fc3 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:27.366354 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-66363111-823b-4f55-b61b-5b1ee7a49fc3 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019816 Oct 04 08:45:27.366885 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 25/50] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Oct 4 08:45:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:45:27.376842 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-b06e0516-eda6-4a1b-aa89-f2c482eb9ccb admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:27.409836 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-b06e0516-eda6-4a1b-aa89-f2c482eb9ccb admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.036470 Oct 04 08:45:27.410743 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 26/51] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Oct 4 08:45:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:45:27.422908 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-ff3a296a-e04d-4b5a-8e86-7b20b2c0a0fd admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:27.428740 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.wsgi [None req-ff3a296a-e04d-4b5a-8e86-7b20b2c0a0fd admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-ff3a296a-e04d-4b5a-8e86-7b20b2c0a0fd admin admin] Request method failure captured: Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Accept: application/json Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Accept-Encoding: gzip, deflate Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Connection: keep-alive Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Content-Length: 0 Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Host: 10.222.0.44 Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Openstack-Api-Version: compute 2.92 Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Openstack-System-Scope: None Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: User-Agent: python-novaclient Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Auth-Token: gAAAAABjO_KmLVazBgChigPbXyK5_Qc5zejy--QL_DltmgNyUoCzULqDMDLCpPHykroebsbPkioEYcJ7el8RstKZUVrMGQf2i2QcteGQtHRA0pQffk8h4ehNEUPZAfuj8cYN5Qi0H2ojQE5REJMLy2VP4e5QKk-xRj3tZz92mgOA0rDS0thK31g Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Domain-Id: None Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Domain-Name: None Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Identity-Status: Confirmed Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Is-Admin-Project: True Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Project-Domain-Id: default Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Project-Domain-Name: Default Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Project-Id: 5d6b22621efa4e2c8d25ad2792cb5242 Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Project-Name: admin Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Role: member,reader,admin Oct 04 08:45:27.430253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Roles: member,reader,admin Oct 04 08:45:27.431918 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5d6b22621efa4e2c8d25ad2792cb5242", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d6b22621efa4e2c8d25ad2792cb5242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:45:27.431918 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Tenant: admin Oct 04 08:45:27.431918 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Tenant-Id: 5d6b22621efa4e2c8d25ad2792cb5242 Oct 04 08:45:27.431918 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-Tenant-Name: admin Oct 04 08:45:27.431918 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-User: admin Oct 04 08:45:27.431918 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-User-Domain-Id: default Oct 04 08:45:27.431918 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-User-Domain-Name: Default Oct 04 08:45:27.431918 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-User-Id: 6a7ff5148f6b41108f35cb9aa85b66e2 Oct 04 08:45:27.431918 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: X-User-Name: admin Oct 04 08:45:27.431918 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: method: > Oct 04 08:45:27.431918 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: exception: Flavor 451 could not be found. Oct 04 08:45:27.431918 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: action_args: {'id': '451'} Oct 04 08:45:27.431918 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:27.431918 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:27.432793 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: ERROR nova.api.openstack.wsgi Oct 04 08:45:27.434381 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-ff3a296a-e04d-4b5a-8e86-7b20b2c0a0fd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=127439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:27.436104 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-ff3a296a-e04d-4b5a-8e86-7b20b2c0a0fd admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012488 Oct 04 08:45:27.436104 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 26/52] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Oct 4 08:45:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:28.656440 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-b06e0516-eda6-4a1b-aa89-f2c482eb9ccb admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:28.657448 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-b06e0516-eda6-4a1b-aa89-f2c482eb9ccb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 04 08:45:28.657853 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 27/53] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:29.211750 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-fee2ef2e-ac22-4ae7-8209-fd52abcd7c09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:29.234839 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-fee2ef2e-ac22-4ae7-8209-fd52abcd7c09 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.425654 Oct 04 08:45:29.235382 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 27/54] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Oct 4 08:45:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:30.451233 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-b06e0516-eda6-4a1b-aa89-f2c482eb9ccb admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:30.452587 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-b06e0516-eda6-4a1b-aa89-f2c482eb9ccb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 Oct 04 08:45:30.453049 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 28/55] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:31.020434 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-0542986a-8f5b-4912-b4b5-0c658644828b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:31.044917 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-0542986a-8f5b-4912-b4b5-0c658644828b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.449635 Oct 04 08:45:31.045570 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 28/56] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Oct 4 08:45:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:32.292729 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-b06e0516-eda6-4a1b-aa89-f2c482eb9ccb admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:32.293758 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-b06e0516-eda6-4a1b-aa89-f2c482eb9ccb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Oct 04 08:45:32.294163 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 29/57] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:32.853630 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-bafbaa6a-09c9-4246-933b-bef6780eeb7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:32.880132 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-bafbaa6a-09c9-4246-933b-bef6780eeb7f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.451077 Oct 04 08:45:32.880671 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 29/58] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Oct 4 08:45:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:34.105211 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-b06e0516-eda6-4a1b-aa89-f2c482eb9ccb admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:34.107020 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-b06e0516-eda6-4a1b-aa89-f2c482eb9ccb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002514 Oct 04 08:45:34.107688 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 30/59] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:34.669663 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-e28c0cdb-fab5-4c29-8dbe-1de91beba670 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:34.696726 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-e28c0cdb-fab5-4c29-8dbe-1de91beba670 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.444302 Oct 04 08:45:34.697249 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 30/60] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Oct 4 08:45:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:35.938201 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-b06e0516-eda6-4a1b-aa89-f2c482eb9ccb admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:35.939596 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-b06e0516-eda6-4a1b-aa89-f2c482eb9ccb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002002 Oct 04 08:45:35.940187 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 31/61] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:36.507139 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-8afc545e-83c4-4e74-bff4-d1ab0e102a54 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:36.528097 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-8afc545e-83c4-4e74-bff4-d1ab0e102a54 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.449062 Oct 04 08:45:36.528620 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 31/62] 10.222.0.44 () {60 vars in 1202 bytes} [Tue Oct 4 08:45:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:33.481208 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-b06e0516-eda6-4a1b-aa89-f2c482eb9ccb admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:33.482797 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-b06e0516-eda6-4a1b-aa89-f2c482eb9ccb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002289 Oct 04 08:46:33.483449 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 32/63] 10.222.0.44 () {54 vars in 931 bytes} [Tue Oct 4 08:46:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:46:33.498124 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG dbcounter [-] [127439] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=127439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:33.908955 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-3cbb304b-9d28-416a-ab7f-d40f33da2ca1 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:33.929233 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-3cbb304b-9d28-416a-ab7f-d40f33da2ca1 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.437966 Oct 04 08:46:33.929763 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 32/64] 10.222.0.44 () {60 vars in 1292 bytes} [Tue Oct 4 08:46:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:33.954368 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG dbcounter [-] [127440] Writing DB stats nova_api:SELECT=14 {{(pid=127440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:33.958492 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-ccfba4d3-88e5-4bc9-a5f0-fb2d5c368392 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:33.965997 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-ccfba4d3-88e5-4bc9-a5f0-fb2d5c368392 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013061 Oct 04 08:46:33.966494 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 33/65] 10.222.0.44 () {60 vars in 1283 bytes} [Tue Oct 4 08:46:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:33.978406 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-634fdd5b-68fe-4784-abf6-6c88142ff71c admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:33.985815 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-634fdd5b-68fe-4784-abf6-6c88142ff71c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011107 Oct 04 08:46:33.986353 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 33/66] 10.222.0.44 () {60 vars in 1286 bytes} [Tue Oct 4 08:46:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:33.997899 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-bd2c2a05-f81a-45ee-b3bd-59a935f45750 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:34.005368 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-bd2c2a05-f81a-45ee-b3bd-59a935f45750 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011281 Oct 04 08:46:34.005785 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 34/67] 10.222.0.44 () {60 vars in 1286 bytes} [Tue Oct 4 08:46:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:34.016917 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-f2fb8162-5938-48d0-9cb8-499b15f3741b admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:34.024229 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-f2fb8162-5938-48d0-9cb8-499b15f3741b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010780 Oct 04 08:46:34.024740 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 34/68] 10.222.0.44 () {60 vars in 1283 bytes} [Tue Oct 4 08:46:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:33.380916 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-bd2c2a05-f81a-45ee-b3bd-59a935f45750 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:33.381942 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-bd2c2a05-f81a-45ee-b3bd-59a935f45750 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 04 08:49:33.382334 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 35/69] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Oct 4 08:49:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:33.519924 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG dbcounter [-] [127439] Writing DB stats nova_api:SELECT=6 {{(pid=127439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:33.697544 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-19f2b70c-1c9e-4ae4-a856-d3bde2a4efe0 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:33.702676 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-19f2b70c-1c9e-4ae4-a856-d3bde2a4efe0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:33.703177 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-19f2b70c-1c9e-4ae4-a856-d3bde2a4efe0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:33.703639 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-19f2b70c-1c9e-4ae4-a856-d3bde2a4efe0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:33.704383 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-19f2b70c-1c9e-4ae4-a856-d3bde2a4efe0 admin admin] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:33.704837 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-19f2b70c-1c9e-4ae4-a856-d3bde2a4efe0 admin admin] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:33.705253 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-19f2b70c-1c9e-4ae4-a856-d3bde2a4efe0 admin admin] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:33.736891 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-19f2b70c-1c9e-4ae4-a856-d3bde2a4efe0 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.218381 Oct 04 08:49:33.737441 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 35/70] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Oct 4 08:49:33 2022] GET /compute/v2.1/os-services => generated 794 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:49:34.830117 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-bd2c2a05-f81a-45ee-b3bd-59a935f45750 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:34.831150 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-bd2c2a05-f81a-45ee-b3bd-59a935f45750 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 04 08:49:34.831554 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 36/71] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Oct 4 08:49:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:35.043200 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-23ebe728-9cf7-43d6-b644-33249245c2e4 admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:35.046726 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-23ebe728-9cf7-43d6-b644-33249245c2e4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:35.047198 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-23ebe728-9cf7-43d6-b644-33249245c2e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:35.047621 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-23ebe728-9cf7-43d6-b644-33249245c2e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:35.048348 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-23ebe728-9cf7-43d6-b644-33249245c2e4 admin admin] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:35.048786 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-23ebe728-9cf7-43d6-b644-33249245c2e4 admin admin] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:35.049195 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-23ebe728-9cf7-43d6-b644-33249245c2e4 admin admin] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:35.068890 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-23ebe728-9cf7-43d6-b644-33249245c2e4 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.078692 Oct 04 08:49:35.069439 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 36/72] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Oct 4 08:49:34 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:49:46.582749 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-bd2c2a05-f81a-45ee-b3bd-59a935f45750 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:46.583759 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-bd2c2a05-f81a-45ee-b3bd-59a935f45750 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 04 08:49:46.584201 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 37/73] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Oct 4 08:49:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:46.734948 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG dbcounter [-] [127439] Writing DB stats nova_cell0:SELECT=4 {{(pid=127439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:46.736033 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG dbcounter [-] [127439] Writing DB stats nova_cell1:SELECT=4 {{(pid=127439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:46.736991 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG dbcounter [-] [127439] Writing DB stats nova_api:SELECT=8 {{(pid=127439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:46.800536 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-e95e19d6-92d5-45aa-81e6-a8244b08e70d admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:46.805832 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-e95e19d6-92d5-45aa-81e6-a8244b08e70d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:46.806652 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-e95e19d6-92d5-45aa-81e6-a8244b08e70d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:46.807076 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-e95e19d6-92d5-45aa-81e6-a8244b08e70d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:46.807774 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-e95e19d6-92d5-45aa-81e6-a8244b08e70d admin admin] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:46.808236 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-e95e19d6-92d5-45aa-81e6-a8244b08e70d admin admin] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:46.808644 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-e95e19d6-92d5-45aa-81e6-a8244b08e70d admin admin] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:46.833722 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-e95e19d6-92d5-45aa-81e6-a8244b08e70d admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.106265 Oct 04 08:49:46.834263 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 37/74] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Oct 4 08:49:46 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:47.907063 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG nova.api.openstack.wsgi [None req-bd2c2a05-f81a-45ee-b3bd-59a935f45750 admin admin] Calling method '>' {{(pid=127440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:47.908174 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: INFO nova.api.openstack.requestlog [None req-bd2c2a05-f81a-45ee-b3bd-59a935f45750 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 04 08:49:47.908573 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: [pid: 127440|app: 0|req: 38/75] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Oct 4 08:49:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:48.107056 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG nova.api.openstack.wsgi [None req-9e1eb82f-416e-4179-91d6-3939303d5d0f admin admin] Calling method '>' {{(pid=127439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:48.110384 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-9e1eb82f-416e-4179-91d6-3939303d5d0f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:48.110831 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-9e1eb82f-416e-4179-91d6-3939303d5d0f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:48.111254 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-9e1eb82f-416e-4179-91d6-3939303d5d0f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:48.111994 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-9e1eb82f-416e-4179-91d6-3939303d5d0f admin admin] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:48.112450 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-9e1eb82f-416e-4179-91d6-3939303d5d0f admin admin] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:48.112842 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: DEBUG oslo_concurrency.lockutils [None req-9e1eb82f-416e-4179-91d6-3939303d5d0f admin admin] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:48.134583 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: INFO nova.api.openstack.requestlog [None req-9e1eb82f-416e-4179-91d6-3939303d5d0f admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.087242 Oct 04 08:49:48.135124 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: [pid: 127439|app: 0|req: 38/76] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Oct 4 08:49:48 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:47.409211 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: Tue Oct 4 08:50:47 2022 - graceful shutdown triggered... Oct 04 08:50:47.409085 dv-cinder-844563-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 08:50:47.410195 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: Gracefully killing worker 2 (pid: 127440)... Oct 04 08:50:47.411008 dv-cinder-844563-14-iscsi devstack@n-api.service[127439]: Gracefully killing worker 1 (pid: 127439)... Oct 04 08:50:47.541020 dv-cinder-844563-14-iscsi devstack@n-api.service[127440]: DEBUG dbcounter [-] [127440] Writing DB stats nova_api:SELECT=4 {{(pid=127440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:48.410238 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: worker 1 buried after 1 seconds Oct 04 08:50:48.410238 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: worker 2 buried after 1 seconds Oct 04 08:50:48.411273 dv-cinder-844563-14-iscsi devstack@n-api.service[127438]: goodbye to uWSGI. Oct 04 08:50:48.412828 dv-cinder-844563-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 04 08:50:48.413711 dv-cinder-844563-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 08:50:48.417355 dv-cinder-844563-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 08:50:48.431678 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 08:50:48.433833 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 08:50:48 2022] *** Oct 04 08:50:48.433833 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 08:50:48.433833 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 08:50:48.433833 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: nodename: dv-cinder-844563-14-iscsi Oct 04 08:50:48.433833 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: machine: x86_64 Oct 04 08:50:48.433833 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: clock source: unix Oct 04 08:50:48.433833 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: pcre jit disabled Oct 04 08:50:48.433833 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: detected number of CPU cores: 4 Oct 04 08:50:48.433833 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: current working directory: / Oct 04 08:50:48.433833 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: detected binary path: /usr/bin/uwsgi-core Oct 04 08:50:48.433833 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: your processes number limit is 47680 Oct 04 08:50:48.433833 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: your memory page size is 4096 bytes Oct 04 08:50:48.433833 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: detected max file descriptor number: 2048 Oct 04 08:50:48.433833 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: lock engine: pthread robust mutexes Oct 04 08:50:48.435054 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: thunder lock: enabled Oct 04 08:50:48.435054 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 08:50:48.435054 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 08:50:48.477451 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: Python main interpreter initialized at 0x5611377259c0 Oct 04 08:50:48.477451 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: python threads support enabled Oct 04 08:50:48.477451 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: your server socket listen backlog is limited to 100 connections Oct 04 08:50:48.477451 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: your mercy for graceful operations on workers is 90 seconds Oct 04 08:50:48.477988 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 08:50:48.477988 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: *** Operational MODE: preforking *** Oct 04 08:50:48.478235 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: *** uWSGI is running in multiple interpreter mode *** Oct 04 08:50:48.478235 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: spawned uWSGI master process (pid: 142419) Oct 04 08:50:48.478455 dv-cinder-844563-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 04 08:50:48.478980 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: spawned uWSGI worker 1 (pid: 142438, cores: 1) Oct 04 08:50:48.479342 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: spawned uWSGI worker 2 (pid: 142439, cores: 1) Oct 04 08:50:48.479486 dv-cinder-844563-14-iscsi devstack@n-api.service[142419]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 08:50:49.139709 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 08:50:49.162119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 08:50:50.269031 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:50:50.269031 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: from cryptography.utils import int_from_bytes Oct 04 08:50:50.269658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:50:50.269658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: from cryptography.utils import int_from_bytes Oct 04 08:50:50.304392 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:50:50.304392 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: from cryptography.utils import int_from_bytes Oct 04 08:50:50.304987 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:50:50.304987 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: from cryptography.utils import int_from_bytes Oct 04 08:50:52.645524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:50:52.646140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:50:52.646441 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:50:52.646708 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:50:52.646964 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:50:52.647362 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.647686 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.648043 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.648348 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.648679 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.648993 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.649472 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.649804 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.650128 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.650388 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.650698 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.651194 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-14-iscsi {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.651514 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.651810 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.652167 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.652509 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.652797 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.653133 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.653447 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.653956 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.655510 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.655510 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.655510 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.655510 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.655990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.655990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.656301 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.656541 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.656862 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.657193 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.657623 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-14-iscsi {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.657927 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.658252 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.658563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.658979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.659295 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.659579 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.659920 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.660246 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.660551 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.660877 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.661195 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.661504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.661839 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.662118 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.662454 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.662743 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.663060 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.663379 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.663672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.663948 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.664265 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.664585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.664944 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.665266 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.665518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.665768 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.666081 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.666385 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.666709 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.667008 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.667312 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.667604 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.667928 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.668253 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.668555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.668857 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.669163 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.669492 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.669814 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.670113 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.670457 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.670852 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.671083 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.671407 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.671742 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.672090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.672403 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.672706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.673036 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.673325 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.673634 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.673953 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.674267 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.674600 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.674901 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.675148 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.675449 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.675746 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.676094 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.676398 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.676703 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.677002 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.677298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.677629 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.677901 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.678189 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.678507 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.678805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.679106 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.679394 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.679706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.680035 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.680331 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.680741 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.681056 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.681343 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.681650 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.681975 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.682278 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.682596 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.682889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.683208 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.683519 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.683829 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.684147 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.684462 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.684763 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.685064 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.685377 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.685672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.685973 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.686286 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.686587 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.686888 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.687191 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.687490 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.687791 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.688124 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.688424 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.688723 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.689023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.689353 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.689673 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.689984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.690287 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.690587 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.690903 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.691241 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.691572 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.691935 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.692261 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.692592 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.692920 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.693865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.693865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.693865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.694131 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.694445 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.694759 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.695075 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.695386 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.695701 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.696063 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.696425 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.696739 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.697054 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.697362 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.697676 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.698543 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.698543 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.698867 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.699024 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.699280 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.699589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.699959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.700252 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.700561 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.700869 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.701177 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.701524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.701842 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.702157 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.702482 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.702786 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.703105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.703414 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.703720 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.704055 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.704365 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.704675 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.705013 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.705327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.705643 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.705955 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.706264 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.706578 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.706891 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.707201 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.707509 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.707813 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.708140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.708443 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.708748 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.709057 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.709377 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.709707 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.710017 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.710346 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.710649 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.710956 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.711261 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.711569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.711986 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.712307 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.712615 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.712917 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.713239 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.713544 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.713848 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.714169 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.714471 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.714778 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.715089 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.715394 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.716216 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.716216 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.716368 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.716629 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.716978 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.717244 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.717578 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.717905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.718208 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.718528 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.718870 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.719157 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.719457 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.719765 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.720094 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.720399 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.720698 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.721003 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.721300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.721600 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.721755 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:50:52.722202 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.722302 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:50:52.722399 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.722485 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.722567 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:50:52.722786 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.722958 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:50:52.723087 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.723187 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:50:52.723387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.723506 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.723684 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.723829 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.724011 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.724195 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.724355 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.724515 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.724657 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.724897 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.725012 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.725145 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.725317 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.725468 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.725633 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.725788 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.725953 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.726170 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.726274 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.726370 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.726564 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.726663 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.726871 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.727117 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-14-iscsi {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.727215 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.727472 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.727564 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.727784 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.727922 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.728152 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.728265 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.728438 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.728537 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.728741 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.728846 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.729052 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.729169 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.729370 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.729466 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.729678 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.729883 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.730010 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.730250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.730357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.730492 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.730592 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.730801 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.730901 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.731137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.731238 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.731451 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.731550 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.731757 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.731868 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.732120 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.732213 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.732428 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.732519 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.732738 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.732851 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.733049 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.733158 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.733352 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.733474 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-14-iscsi {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.733657 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.733772 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.733968 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.734060 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.734305 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.734404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.734588 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.734739 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.734892 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.735077 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.735214 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.735428 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.735533 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.735681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.735821 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.736017 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.736149 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.736344 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.736461 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.736649 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.736769 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.736966 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.737100 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.737282 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.737408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.737950 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.738069 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.738250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.738388 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.738559 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.738699 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.738868 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.739005 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.739189 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.739313 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.739490 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.739616 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.739790 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.739968 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.740081 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.740364 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.740459 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.740545 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.740700 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.740856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.741021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.741164 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.741343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.741466 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.741595 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.741778 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.741860 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.742090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.742194 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.742390 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.742478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.742690 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.742771 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.743134 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.743236 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.743395 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.743483 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.743800 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.744011 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.744120 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.744203 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.744356 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.744478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.744622 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.744727 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.744926 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.745018 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.745242 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.745344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.745549 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.745660 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.745850 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.745943 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.746154 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.746246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.746476 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.746669 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.746795 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.746898 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.747100 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.747192 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.747400 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.747497 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.747695 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.747786 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.748038 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.748137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.748351 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.748450 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.748662 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.748742 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.748971 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.749051 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.749279 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.749445 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.749575 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.749665 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.749879 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.749967 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.750185 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.750285 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.750503 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.750606 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.750787 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.750883 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.751035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.751117 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.751398 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.751557 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.751705 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.751873 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.752052 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.752193 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.752340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.752477 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.752692 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.752855 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.753010 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.753149 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.753381 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.753524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.753672 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.753829 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.754068 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.754068 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.754333 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.754470 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.754606 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.754763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.754911 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.755048 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.755184 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.755403 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.755545 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.755790 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.755967 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.756106 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.756253 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.756406 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.756661 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.756812 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.756952 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.757101 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.757248 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.757387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.757523 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.757671 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.757820 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.757975 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.758123 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.758260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.758443 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.758603 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.758741 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.758878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.759024 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.759172 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.759333 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.759558 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.759700 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.759851 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.760038 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.760190 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.760594 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.760757 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.760905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.761043 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.761222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.761371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.761518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.761666 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.761805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.761953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.762110 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.762257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.762404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.762551 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.762697 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.762836 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.762973 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.763120 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.763274 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.763498 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.763652 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.763792 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.763956 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.764131 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.764356 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.764500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.764639 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.764776 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.764916 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.765064 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.765064 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.765323 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.765538 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.765687 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.765910 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.766074 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.766074 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.766335 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.766335 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.766604 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.766839 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.766998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.766998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.767268 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:50:52.767410 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.767562 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.767708 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.767863 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.768044 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.768182 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.768320 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.768493 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.768652 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.768802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.768949 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.769086 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.769235 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.769381 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.769527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.769748 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.769915 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.770056 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.770143 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.770217 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.770300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.770381 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.770455 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.770549 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.770811 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.770895 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.770979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.771053 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.771124 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.771124 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.771271 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.771353 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.771443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.771524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.771597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.771675 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.771748 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.771913 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.772000 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.772248 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.772333 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.772552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.772640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.772856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.772945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.773156 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.773237 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.773463 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.773559 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.773772 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.773886 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.774071 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.774162 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.774458 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.774566 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.774766 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.774856 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.775067 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.775156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.775370 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.775553 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.775701 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.775809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.775999 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.776678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.776853 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.777089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.777256 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.777408 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.777560 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.777711 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.777854 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.778007 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.778150 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.778298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.778440 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.778621 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.778785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.778931 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.779092 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.779368 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.779528 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.779680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.780033 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.780187 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.780338 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.780482 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.780625 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.780946 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.781108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.781384 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.781553 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.781700 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.781863 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.782014 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.782172 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.782316 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.782458 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.782609 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.783662 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.783944 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.784111 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.784257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.784410 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.784672 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.784836 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.784981 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.785123 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.785267 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.785425 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.785569 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.785713 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.785955 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.786208 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.786366 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.786524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.786675 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.786818 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.786996 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.787296 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.787499 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.787665 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.787809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.787975 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.788122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.788309 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.788484 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.788697 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.788848 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.788992 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.789142 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.789302 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.789539 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.789708 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.789969 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.790217 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.790379 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.790532 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.790691 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.790854 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.791172 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.791318 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.791462 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.791605 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.791771 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.791970 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.792121 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.792265 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.792408 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.792551 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.792709 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.792854 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.792996 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.793147 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.793290 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.793447 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.793629 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.794770 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.794940 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.795088 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.795240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.795401 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.795546 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.795702 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.796139 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.796393 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.796553 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.796712 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.796881 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.796983 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.796983 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.797148 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.797233 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.797344 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.797431 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.797523 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.797609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.797694 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.797791 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.797884 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.797970 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.798062 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.798146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.798241 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.798337 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.798431 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.798524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.798620 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.798855 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.798959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.798959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.799127 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.799213 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.799297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.799380 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.799472 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.799583 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.799679 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.799772 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.799857 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.799959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.800059 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.800147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.800255 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.800329 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.800418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.800511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.800610 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.800696 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.800780 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.800863 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.800954 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.801219 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.801365 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.801460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.801546 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.801639 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.801725 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.801808 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.801901 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.801996 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.802088 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.802179 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.802266 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.802363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.802448 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.802531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.802614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.802697 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.802788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.802887 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.802980 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.803065 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.803156 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.803240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.803330 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.803424 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.803517 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.803610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.803703 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.803796 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.803903 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.804004 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.804099 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.804193 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.804285 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.804378 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.804487 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.804563 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.804646 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.804736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.804836 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.804920 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.805013 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.805097 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.805191 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.805276 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.805430 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.805576 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.805769 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.805873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.806090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.806182 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.806416 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.806535 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.806725 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.806823 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.807038 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.807141 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.807340 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.807449 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.807648 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.807742 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.807991 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.808103 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.808303 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.808408 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.808620 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.808722 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.808934 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.809087 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.809257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.809405 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.809570 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.809726 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.809866 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.810008 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.810147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.810304 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.810460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.810596 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.810788 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.810928 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.811123 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.811257 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.811464 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.811626 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.811773 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.811940 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.812047 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.812135 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.812351 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.812444 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.812660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.812759 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.812966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.813062 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.813270 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.813370 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.813571 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.813662 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.813870 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.813970 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.814182 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.814272 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.814479 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.814580 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.814792 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.814883 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.815096 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.815196 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.815411 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.815512 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.815721 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.815811 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.816044 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.816151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.816353 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.816481 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.816659 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.816762 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.816958 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.817106 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.817259 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.817371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.817563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.817662 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.817882 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.817979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.818185 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.818286 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.818490 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.818581 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.818817 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.818931 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.819125 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.819212 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.819429 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.819510 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.819734 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.819823 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.820074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.820158 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.820405 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.820488 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.820712 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.820791 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.821014 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.821157 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.821401 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.821518 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.821701 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.821804 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.822010 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.822091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.822317 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.822406 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.822627 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.822733 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.822928 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.823009 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.823228 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.823309 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.823534 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.823626 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.823833 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.823945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.824158 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.824253 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.824458 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.824556 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.824777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.824870 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.825075 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.825156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.825394 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.825483 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.825701 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.825784 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.826002 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.826090 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.826349 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.826443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.826602 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.826702 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.826921 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.827019 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.827225 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.827324 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.827551 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.827829 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.827953 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.828191 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.828295 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.828505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.828608 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.828818 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.828918 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.829130 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.829230 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.829441 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.829543 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.829753 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.829845 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.830065 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.830159 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.830376 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.830467 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.830681 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.830772 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.830995 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.831087 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.831308 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.831407 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.831610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.831712 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.831950 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.832265 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.832364 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.832570 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.832729 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.832876 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.833082 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.833175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.833428 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.833536 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.833766 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.833863 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.834072 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.834170 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.834378 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.834484 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.834693 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.834782 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.835000 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.835101 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.835311 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.835432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.835616 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.835782 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.835973 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.836204 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.836317 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.836583 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.836681 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.836915 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.837036 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.837226 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.837394 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.837573 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.837726 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.837879 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.838060 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.838217 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.838388 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.838549 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.838714 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.838893 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.839083 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.839186 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.839408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.839489 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.839725 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.839814 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.840079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.840180 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.840404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.840492 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.840708 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.840799 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.841017 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.841116 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.841324 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.841413 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.841627 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.841724 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.841936 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.842023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.842244 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.842343 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.842554 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.842654 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.842861 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.842951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.843164 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.843261 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.843472 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.843571 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.843776 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.843873 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.844117 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.844220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.844429 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.844630 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.844738 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.844959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.845057 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.845282 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.845387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.845613 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.845818 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.845919 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.846145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.846276 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.846489 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.846624 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.846846 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.847088 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.847189 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.847372 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.847479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.847692 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.847805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.848025 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.848130 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.848334 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.848439 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.848638 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.848731 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.848959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.849060 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.849273 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.849367 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.849576 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.849677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.849878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.849981 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.850185 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.850286 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.850487 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.850592 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.850794 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.850898 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.851101 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.851202 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.851425 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.851517 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.851743 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.851989 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.852106 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.852384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.852514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.852714 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.852806 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.853021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.853115 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.853328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.853431 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.853641 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.853748 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.853981 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.854077 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.854249 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.854343 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.854566 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.854668 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.854869 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.854967 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.855174 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.855271 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.855492 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.855592 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.855802 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.855990 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.856133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.856217 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.856573 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.856683 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.856760 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.856869 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.857072 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.857180 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.857419 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.857524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.857738 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.857821 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.858046 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.858127 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.858362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.858446 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.858683 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.858886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.858991 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.859309 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.859623 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.860035 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.860134 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.860272 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.860405 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.860711 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.860819 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.861123 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.861225 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.861346 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.861442 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.861696 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.861862 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.862027 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.862226 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.862373 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.862863 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.863015 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.863153 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.863300 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.863444 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.863593 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.863730 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.863951 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.864120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.864256 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.864438 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.864573 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.864747 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.864895 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.865073 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.865210 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.865388 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.865530 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.865717 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.865850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.866039 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.866178 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.866355 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.866494 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.866687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.866825 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.867004 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.867137 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.867321 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.867587 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.867734 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.867984 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.868083 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.868312 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.868403 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.868630 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.868735 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.868946 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.869048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.869266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.869428 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.869574 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.869678 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.869903 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.869998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.870219 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.870323 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.870527 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.870628 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.870838 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.870930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.871145 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.871244 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.871454 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.871554 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.871762 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.871862 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.872104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.872253 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.872398 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.872540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.872710 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.872845 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.873021 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.873164 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.873334 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.873468 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.873649 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.873791 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.873963 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.874106 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.874277 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.874411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.874589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.874729 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.874907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.875049 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.875255 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.875355 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.875589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.875721 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.875942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.876087 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.876242 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.876379 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.876559 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.876713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.876872 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.877016 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.877183 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.877322 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.877489 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.877577 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.877797 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.877886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.878105 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.878259 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.878430 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.878564 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.878737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.878878 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.879045 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.879177 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.879464 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.879621 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.879767 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.879917 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.880101 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.880190 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.880423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.880531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.880735 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.880827 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.881058 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.881156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.881427 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.881539 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.881752 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.881841 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.882079 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.882176 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.882393 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.882499 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.882702 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.882792 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.883017 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.883106 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.883345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.883437 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.883731 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.883838 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.884074 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.884169 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.884383 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.884482 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.884689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.884780 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.885000 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.885097 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.885319 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.885419 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.885630 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.885720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.885934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.886033 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.886239 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.886363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.886549 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.886693 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.886856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.887009 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.887162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.887336 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.887468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.887667 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.887776 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.888022 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.888117 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.888338 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.888428 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.888656 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.888740 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.888975 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.889064 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.889284 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.889371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.889589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.889683 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.889894 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.889977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.890205 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.890284 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.890510 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.890603 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.890816 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.890895 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.891125 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.891205 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.891429 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.891517 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.891734 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.891818 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.892077 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.892177 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.892409 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.892512 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.892730 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.892826 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.893066 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.893145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.893391 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.893479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.893696 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.893774 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.894018 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.894103 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.894328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.894415 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.894642 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.894725 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.894952 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.895031 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.895264 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.895343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.895666 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.895765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.896055 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.896150 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.896279 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.896368 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.896628 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.896786 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.896942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.897089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.897256 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.897425 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.897641 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.897739 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.897953 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.898097 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.898241 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.898375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.898545 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.898689 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.898897 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.899048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.899223 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.899359 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.899521 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.899660 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.899838 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.899956 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.900175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.900275 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.900489 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.900586 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.900803 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.900911 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.901115 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.901212 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.901428 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.901518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.901736 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.901817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.902048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.902138 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.902349 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.902465 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.902666 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.902767 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.902976 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.903064 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.903296 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.903407 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.903611 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.903712 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.903948 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.904074 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.904260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.904394 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.904574 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.904685 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.904900 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.905064 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.905217 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.905369 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.905517 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.905659 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.905935 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.906091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.906251 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.906337 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.906468 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.906675 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.906827 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.906930 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.907123 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.907271 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.907579 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.907680 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.907680 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=142439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:50:52.908011 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.908416 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.908416 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.908715 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.909036 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.909366 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.909689 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.910260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.910590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.910916 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.911231 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.911543 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.911859 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.912203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.912515 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.912824 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.913136 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.913447 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.913776 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.914101 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.914438 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.914775 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.915200 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.915519 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.915948 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.916235 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.916805 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.917310 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.917806 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.918307 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.918840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.919384 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.919857 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.920380 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.920873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.921363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.921850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.922334 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.922833 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.923323 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.923833 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.924404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.924914 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.925426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.925915 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.926437 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.927399 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.928010 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.928642 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.929257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.929846 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.930461 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.931030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.931663 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.932249 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.933202 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.933202 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.933463 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.933777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.934123 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.934470 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.934767 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.935101 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.935423 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.936108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.936400 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.936724 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.937066 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.937389 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.937713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.938027 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.939926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.940343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.940828 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.941953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.941953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.942291 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.942512 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.942851 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.943176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.943494 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.943816 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.944595 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.944595 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.944826 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.945145 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.945459 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.945789 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.946262 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.946505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.946818 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.947145 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.947468 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.947781 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.948241 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.948630 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.948929 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.949226 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.949541 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.949850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.950188 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.950499 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.950815 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.951145 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.951459 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.951787 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.952134 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.952460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.952821 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.953143 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.953758 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.954100 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.954430 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.954778 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.955116 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.955427 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.955744 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.956117 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.956452 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.956764 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.957088 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.957410 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.957723 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.958033 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.958345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.958662 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.959085 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.959284 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.959600 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.959977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.960246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.960564 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.960878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.961213 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.961559 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.961958 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.962393 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.962594 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.963654 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.963654 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.963654 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.964136 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.964292 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.964565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.964903 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.965581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.965581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.965959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.966284 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.966608 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.966940 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.967260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.967645 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.967921 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.968240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.968566 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.968890 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.969207 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.969556 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.969894 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.970090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO dbcounter [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] Registered counter for database nova_api Oct 04 08:50:52.970259 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.970517 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.970828 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.971134 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.971444 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.971762 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.972123 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.972430 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.972739 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.973052 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.973363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.973670 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.973972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.974275 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.974583 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.974889 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.975192 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.975504 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.975805 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.976141 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.976446 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.976758 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.977066 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.977422 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.977753 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.978054 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.978366 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.978706 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.979047 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.979365 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.979688 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.984514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.984514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.984514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.984514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.984514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.984514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.984514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.984514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.986347 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.986347 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.986347 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.986347 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.986347 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.986347 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.986347 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.986347 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.987930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.987930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.987930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.987930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.987930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.987930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.987930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.987930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.989446 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.989446 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.989446 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.992103 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.992692 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.993068 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.993424 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.993731 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_db.sqlalchemy.engines [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:50:52.993839 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.994102 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.994479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.994858 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.995208 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.995522 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.995864 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.996340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.996647 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.997035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.997504 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.997704 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.998125 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.998460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:50:52.998784 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=142438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:50:53.001846 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writer thread running {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:50:53.058937 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.context [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),741e120e-a520-4525-9dbb-b6709af0a52b(cell1) {{(pid=142439) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 08:50:53.061661 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO dbcounter [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] Registered counter for database nova_api Oct 04 08:50:53.063189 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:53.063655 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:53.065365 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:53.066153 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:53.066621 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:53.068708 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:53.071448 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO dbcounter [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] Registered counter for database nova_cell0 Oct 04 08:50:53.075874 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO dbcounter [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] Registered counter for database nova_cell1 Oct 04 08:50:53.083936 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_db.sqlalchemy.engines [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:50:53.086569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_db.sqlalchemy.engines [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:50:53.087817 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_db.sqlalchemy.engines [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:50:53.091048 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writer thread running {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:50:53.095250 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writer thread running {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:50:53.096631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writer thread running {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:50:53.151250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.context [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),741e120e-a520-4525-9dbb-b6709af0a52b(cell1) {{(pid=142438) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 08:50:53.155397 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:53.155866 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:53.157478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:53.158226 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:53.158809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:53.160936 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:53.163077 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO dbcounter [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] Registered counter for database nova_cell0 Oct 04 08:50:53.168328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO dbcounter [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] Registered counter for database nova_cell1 Oct 04 08:50:53.175660 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_db.sqlalchemy.engines [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:50:53.178869 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_db.sqlalchemy.engines [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:50:53.186737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writer thread running {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:50:53.188131 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writer thread running {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:50:53.250588 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO dbcounter [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] Registered counter for database nova_cell0 Oct 04 08:50:53.257834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_db.sqlalchemy.engines [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:50:53.262818 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writer thread running {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:50:53.333916 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO dbcounter [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] Registered counter for database nova_cell0 Oct 04 08:50:53.341518 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_db.sqlalchemy.engines [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:50:53.346711 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writer thread running {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:50:53.578421 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: WARNING keystonemiddleware.auth_token [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:50:53.585839 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: WARNING keystonemiddleware.auth_token [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:50:53.658702 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: WARNING keystonemiddleware.auth_token [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:50:53.666140 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: WARNING keystonemiddleware.auth_token [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:50:53.930100 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: WARNING keystonemiddleware.auth_token [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:50:53.936324 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: WARNING keystonemiddleware.auth_token [None req-8e6908c0-9ed7-488a-9062-1364b5cf8b25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:50:53.941685 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5611377259c0 pid: 142439 (default app) Oct 04 08:50:54.007495 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: WARNING keystonemiddleware.auth_token [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:50:54.013589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: WARNING keystonemiddleware.auth_token [None req-11fb5196-e682-484f-9d28-e33adc95e7e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:50:54.018809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5611377259c0 pid: 142438 (default app) Oct 04 08:51:30.721307 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=3 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:30.722202 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=3 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:30.722982 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=3 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:30.723773 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=3 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:31.201260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=3 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:31.202100 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=3 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:31.203300 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=3 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:31.205351 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=3 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:32.308529 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-02814958-b935-404f-954e-befd43e4ec51 tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] Action: 'create', calling method: .version_select at 0x7ff92f32e4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1946960939", "metadata": {"Type": "work"}}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:32.850471 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c4193c0c-143d-462e-9688-d53b7bf43c83 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Action: 'create', calling method: .version_select at 0x7ff92f3304c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1795987749"}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:34.418840 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-02814958-b935-404f-954e-befd43e4ec51 tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.708259 Oct 04 08:51:34.420086 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1156 bytes} [Tue Oct 4 08:51:30 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3711 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 08:51:34.607204 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c4193c0c-143d-462e-9688-d53b7bf43c83 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.419046 Oct 04 08:51:34.608585 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 1/2] 10.222.0.44 () {60 vars in 1155 bytes} [Tue Oct 4 08:51:31 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3422 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 08:51:34.617555 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-89a7ffdc-b64e-43b1-8f26-036587528d8c tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] Calling method '.version_select at 0x7ff92f2043a0>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:34.675731 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a37ffb05-8beb-42ee-9be5-4a435c148fe6 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Action: 'create', calling method: .version_select at 0x7ff92f202310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1608550696", "metadata": {"Type": "work"}}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a37ffb05-8beb-42ee-9be5-4a435c148fe6 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Request method failure captured: Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 122 Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_QTqCp3pdvGNh_iissrBYmg6dcxYgqKUSdh01ZNljalYTFBU8xJItyQIguL-eKceWCF80mFLutNZ1S5i5isBAugPtYoIZPbfb3LaIpMpOUnLPXquNVYOXJBNrw7nSwntaNtt5A1Ncgldxzl5XXlR17V33bRBYxGcO3ZTL4r6byQlKc Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 91d94cf00a1f41c7881a9e222a821cc8 Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 08:51:34.682107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 08:51:34.683563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_91d94cf00a1f41c7881a9e222a821cc8", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:51:34.683563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:34.683563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 91d94cf00a1f41c7881a9e222a821cc8 Oct 04 08:51:34.683563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:34.683563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-VolumesNegativeTest-1109829060-project Oct 04 08:51:34.683563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 08:51:34.683563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 08:51:34.683563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 9e28fc8794894af2a7d4459318f61abf Oct 04 08:51:34.683563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-VolumesNegativeTest-1109829060-project Oct 04 08:51:34.683563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Oct 04 08:51:34.683563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1608550696", "metadata": {"Type": "work"}}} Oct 04 08:51:34.683563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: Oct 04 08:51:34.683563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1608550696', 'metadata': {'Type': 'work'}}}} Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise error Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:34.684751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 08:51:34.686091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 08:51:34.687266 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 08:51:34.687266 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.692208 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a37ffb05-8beb-42ee-9be5-4a435c148fe6 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:34.694686 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a37ffb05-8beb-42ee-9be5-4a435c148fe6 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.272917 Oct 04 08:51:34.700797 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 2/3] 10.222.0.44 () {60 vars in 1156 bytes} [Tue Oct 4 08:51:34 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 280 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:51:34.706947 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-750250ae-cd92-49e7-9009-194913435212 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f198e50>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:34.733082 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-89a7ffdc-b64e-43b1-8f26-036587528d8c tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1993557e-7516-4074-9804-e88607a0d2ff" status: 200 len: 353 microversion: 2.1 time: 0.121914 Oct 04 08:51:34.734638 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:51:34 2022] GET /compute/v2.1/os-volumes/1993557e-7516-4074-9804-e88607a0d2ff => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:34.741369 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a5386d37-9c1b-45d0-8e75-a7d15a5e7c57 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Action: 'create', calling method: .version_select at 0x7ff92f204a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-531283243", "metadata": {"Type": "work"}}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a5386d37-9c1b-45d0-8e75-a7d15a5e7c57 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Request method failure captured: Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 119 Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_QTqCp3pdvGNh_iissrBYmg6dcxYgqKUSdh01ZNljalYTFBU8xJItyQIguL-eKceWCF80mFLutNZ1S5i5isBAugPtYoIZPbfb3LaIpMpOUnLPXquNVYOXJBNrw7nSwntaNtt5A1Ncgldxzl5XXlR17V33bRBYxGcO3ZTL4r6byQlKc Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 91d94cf00a1f41c7881a9e222a821cc8 Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 08:51:34.758137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 08:51:34.759926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_91d94cf00a1f41c7881a9e222a821cc8", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:51:34.759926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:34.759926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 91d94cf00a1f41c7881a9e222a821cc8 Oct 04 08:51:34.759926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:34.759926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-VolumesNegativeTest-1109829060-project Oct 04 08:51:34.759926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 08:51:34.759926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 08:51:34.759926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 9e28fc8794894af2a7d4459318f61abf Oct 04 08:51:34.759926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-VolumesNegativeTest-1109829060-project Oct 04 08:51:34.759926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Oct 04 08:51:34.759926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-531283243", "metadata": {"Type": "work"}}} Oct 04 08:51:34.759926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: Oct 04 08:51:34.759926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-531283243', 'metadata': {'Type': 'work'}}}} Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise error Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi '0' Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:34.760874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 08:51:34.762443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 08:51:34.763967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 08:51:34.763967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.767244 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a5386d37-9c1b-45d0-8e75-a7d15a5e7c57 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:34.768418 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a5386d37-9c1b-45d0-8e75-a7d15a5e7c57 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.032638 Oct 04 08:51:34.770998 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 3/5] 10.222.0.44 () {60 vars in 1156 bytes} [Tue Oct 4 08:51:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:51:34.786328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-71e7faf9-b0a6-49f1-91f9-ef6035b1103b tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Action: 'create', calling method: .version_select at 0x7ff92f2145e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-457037307", "metadata": {"Type": "work"}}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-71e7faf9-b0a6-49f1-91f9-ef6035b1103b tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Request method failure captured: Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 118 Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_QTqCp3pdvGNh_iissrBYmg6dcxYgqKUSdh01ZNljalYTFBU8xJItyQIguL-eKceWCF80mFLutNZ1S5i5isBAugPtYoIZPbfb3LaIpMpOUnLPXquNVYOXJBNrw7nSwntaNtt5A1Ncgldxzl5XXlR17V33bRBYxGcO3ZTL4r6byQlKc Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 91d94cf00a1f41c7881a9e222a821cc8 Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 08:51:34.794330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 08:51:34.796006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_91d94cf00a1f41c7881a9e222a821cc8", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:51:34.796006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:34.796006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 91d94cf00a1f41c7881a9e222a821cc8 Oct 04 08:51:34.796006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:34.796006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-VolumesNegativeTest-1109829060-project Oct 04 08:51:34.796006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 08:51:34.796006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 08:51:34.796006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 9e28fc8794894af2a7d4459318f61abf Oct 04 08:51:34.796006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-VolumesNegativeTest-1109829060-project Oct 04 08:51:34.796006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Oct 04 08:51:34.796006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-457037307", "metadata": {"Type": "work"}}} Oct 04 08:51:34.796006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: Oct 04 08:51:34.796006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-457037307', 'metadata': {'Type': 'work'}}}} Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise error Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi '' Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:34.797205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 08:51:34.798732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 08:51:34.800199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 08:51:34.800199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.808008 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-71e7faf9-b0a6-49f1-91f9-ef6035b1103b tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:34.809210 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-71e7faf9-b0a6-49f1-91f9-ef6035b1103b tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.033066 Oct 04 08:51:34.810262 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 4/6] 10.222.0.44 () {60 vars in 1156 bytes} [Tue Oct 4 08:51:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:51:34.820493 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ba1f63b5-0915-4b3e-b2f7-cf86cd9acfa5 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Calling method '.version_select at 0x7ff92f204430>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:34.844554 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-750250ae-cd92-49e7-9009-194913435212 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627" status: 200 len: 345 microversion: 2.1 time: 0.141861 Oct 04 08:51:34.845481 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 3/7] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:51:34 2022] GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627 => generated 345 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:34.882619 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-ba1f63b5-0915-4b3e-b2f7-cf86cd9acfa5 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] HTTP exception thrown: Volume tempest-invalid-2123940501 could not be found. Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ba1f63b5-0915-4b3e-b2f7-cf86cd9acfa5 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Request method failure captured: Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2123940501 HTTP/1.1 Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_QTqCp3pdvGNh_iissrBYmg6dcxYgqKUSdh01ZNljalYTFBU8xJItyQIguL-eKceWCF80mFLutNZ1S5i5isBAugPtYoIZPbfb3LaIpMpOUnLPXquNVYOXJBNrw7nSwntaNtt5A1Ncgldxzl5XXlR17V33bRBYxGcO3ZTL4r6byQlKc Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 91d94cf00a1f41c7881a9e222a821cc8 Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 08:51:34.898203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 08:51:34.899597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_91d94cf00a1f41c7881a9e222a821cc8", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:51:34.899597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:34.899597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 91d94cf00a1f41c7881a9e222a821cc8 Oct 04 08:51:34.899597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:34.899597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-VolumesNegativeTest-1109829060-project Oct 04 08:51:34.899597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 08:51:34.899597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 08:51:34.899597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 9e28fc8794894af2a7d4459318f61abf Oct 04 08:51:34.899597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-VolumesNegativeTest-1109829060-project Oct 04 08:51:34.899597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: Oct 04 08:51:34.899597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Volume tempest-invalid-2123940501 could not be found. Oct 04 08:51:34.899597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': 'tempest-invalid-2123940501'} Oct 04 08:51:34.899597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2123940501 could not be found. (HTTP 404) (Request-ID: req-f9dbe31d-fb0d-437c-b586-737be6f21b1f) Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:34.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:51:34.901765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2123940501 could not be found. Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:51:34.948902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2123940501 could not be found. Oct 04 08:51:34.952348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.952348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:34.952348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.952348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:34.952348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:34.952348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:34.952348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:51:34.952348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:51:34.952348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2123940501 could not be found. Oct 04 08:51:34.952348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:34.952348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ba1f63b5-0915-4b3e-b2f7-cf86cd9acfa5 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Returning 404 to user: Volume tempest-invalid-2123940501 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:34.952348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ba1f63b5-0915-4b3e-b2f7-cf86cd9acfa5 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2123940501" status: 404 len: 99 microversion: 2.1 time: 0.085968 Oct 04 08:51:34.952348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 5/8] 10.222.0.44 () {58 vars in 1218 bytes} [Tue Oct 4 08:51:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2123940501 => generated 99 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 08:51:34.956371 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-7cc28dbb-82c9-4f7f-bd88-816f6f859a23 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004369 Oct 04 08:51:34.956495 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-501bb039-6876-4025-9444-1c4a41029501 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003910 Oct 04 08:51:34.956574 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 4/9] 10.222.0.44 () {58 vars in 1140 bytes} [Tue Oct 4 08:51:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 08:51:34.956574 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-51a1b1cd-a5f6-482b-ab7c-f0d9ec67ff51 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Calling method '.version_select at 0x7ff92f2028b0>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:34.956694 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 6/10] 10.222.0.44 () {58 vars in 1137 bytes} [Tue Oct 4 08:51:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 08:51:35.017356 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-51a1b1cd-a5f6-482b-ab7c-f0d9ec67ff51 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] HTTP exception thrown: Volume 28a3a5fd-e8f7-4c30-ae4b-fe8402acc2d2 could not be found. Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-51a1b1cd-a5f6-482b-ab7c-f0d9ec67ff51 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Request method failure captured: Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: DELETE /compute/v2.1/os-volumes/28a3a5fd-e8f7-4c30-ae4b-fe8402acc2d2 HTTP/1.1 Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_QTqCp3pdvGNh_iissrBYmg6dcxYgqKUSdh01ZNljalYTFBU8xJItyQIguL-eKceWCF80mFLutNZ1S5i5isBAugPtYoIZPbfb3LaIpMpOUnLPXquNVYOXJBNrw7nSwntaNtt5A1Ncgldxzl5XXlR17V33bRBYxGcO3ZTL4r6byQlKc Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 91d94cf00a1f41c7881a9e222a821cc8 Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 08:51:35.020998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 08:51:35.021984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_91d94cf00a1f41c7881a9e222a821cc8", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:51:35.021984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:35.021984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 91d94cf00a1f41c7881a9e222a821cc8 Oct 04 08:51:35.021984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:35.021984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-VolumesNegativeTest-1109829060-project Oct 04 08:51:35.021984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 08:51:35.021984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 08:51:35.021984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 9e28fc8794894af2a7d4459318f61abf Oct 04 08:51:35.021984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-VolumesNegativeTest-1109829060-project Oct 04 08:51:35.021984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: Oct 04 08:51:35.021984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Volume 28a3a5fd-e8f7-4c30-ae4b-fe8402acc2d2 could not be found. Oct 04 08:51:35.021984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': '28a3a5fd-e8f7-4c30-ae4b-fe8402acc2d2'} Oct 04 08:51:35.021984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 28a3a5fd-e8f7-4c30-ae4b-fe8402acc2d2 could not be found. (HTTP 404) (Request-ID: req-f44afca2-fd54-48d2-ad5f-11a8012e8332) Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:35.022555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:51:35.024942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 28a3a5fd-e8f7-4c30-ae4b-fe8402acc2d2 could not be found. Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 08:51:35.025794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:51:35.026585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 28a3a5fd-e8f7-4c30-ae4b-fe8402acc2d2 could not be found. Oct 04 08:51:35.026585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:35.026585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:35.026585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:35.026585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:35.026585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:35.026585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:35.026585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:51:35.026585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:51:35.026585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 28a3a5fd-e8f7-4c30-ae4b-fe8402acc2d2 could not be found. Oct 04 08:51:35.026585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:35.026585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-51a1b1cd-a5f6-482b-ab7c-f0d9ec67ff51 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Returning 404 to user: Volume 28a3a5fd-e8f7-4c30-ae4b-fe8402acc2d2 could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:35.026585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-51a1b1cd-a5f6-482b-ab7c-f0d9ec67ff51 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/28a3a5fd-e8f7-4c30-ae4b-fe8402acc2d2" status: 404 len: 109 microversion: 2.1 time: 0.090473 Oct 04 08:51:35.026585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 5/11] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Oct 4 08:51:34 2022] DELETE /compute/v2.1/os-volumes/28a3a5fd-e8f7-4c30-ae4b-fe8402acc2d2 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:51:35.033116 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e569dfa3-ac2e-4544-9b20-cbbf9f4c9ff0 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Calling method '.version_select at 0x7ff92f126160>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:35.084724 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-e569dfa3-ac2e-4544-9b20-cbbf9f4c9ff0 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] HTTP exception thrown: Volume b98eab2e-5f88-4b56-885b-af2f9277ec6a could not be found. Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e569dfa3-ac2e-4544-9b20-cbbf9f4c9ff0 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Request method failure captured: Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/os-volumes/b98eab2e-5f88-4b56-885b-af2f9277ec6a HTTP/1.1 Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_QTqCp3pdvGNh_iissrBYmg6dcxYgqKUSdh01ZNljalYTFBU8xJItyQIguL-eKceWCF80mFLutNZ1S5i5isBAugPtYoIZPbfb3LaIpMpOUnLPXquNVYOXJBNrw7nSwntaNtt5A1Ncgldxzl5XXlR17V33bRBYxGcO3ZTL4r6byQlKc Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 91d94cf00a1f41c7881a9e222a821cc8 Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 08:51:35.086765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 08:51:35.087808 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_91d94cf00a1f41c7881a9e222a821cc8", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91d94cf00a1f41c7881a9e222a821cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:51:35.087808 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:35.087808 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 91d94cf00a1f41c7881a9e222a821cc8 Oct 04 08:51:35.087808 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-VolumesNegativeTest-1109829060 Oct 04 08:51:35.087808 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-VolumesNegativeTest-1109829060-project Oct 04 08:51:35.087808 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 08:51:35.087808 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 08:51:35.087808 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 9e28fc8794894af2a7d4459318f61abf Oct 04 08:51:35.087808 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-VolumesNegativeTest-1109829060-project Oct 04 08:51:35.087808 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: Oct 04 08:51:35.087808 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Volume b98eab2e-5f88-4b56-885b-af2f9277ec6a could not be found. Oct 04 08:51:35.087808 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': 'b98eab2e-5f88-4b56-885b-af2f9277ec6a'} Oct 04 08:51:35.087808 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b98eab2e-5f88-4b56-885b-af2f9277ec6a could not be found. (HTTP 404) (Request-ID: req-a38617df-dff8-4b95-a04f-b8b0ce45f236) Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:35.088460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:51:35.089361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b98eab2e-5f88-4b56-885b-af2f9277ec6a could not be found. Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 08:51:35.090340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:51:35.091176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b98eab2e-5f88-4b56-885b-af2f9277ec6a could not be found. Oct 04 08:51:35.091176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:35.091176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:35.091176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:35.091176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:35.091176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:35.091176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:35.091176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:51:35.091176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:51:35.091176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b98eab2e-5f88-4b56-885b-af2f9277ec6a could not be found. Oct 04 08:51:35.091176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:35.091176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e569dfa3-ac2e-4544-9b20-cbbf9f4c9ff0 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] Returning 404 to user: Volume b98eab2e-5f88-4b56-885b-af2f9277ec6a could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:35.091176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e569dfa3-ac2e-4544-9b20-cbbf9f4c9ff0 tempest-VolumesNegativeTest-1109829060 tempest-VolumesNegativeTest-1109829060-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b98eab2e-5f88-4b56-885b-af2f9277ec6a" status: 404 len: 109 microversion: 2.1 time: 0.059375 Oct 04 08:51:35.097376 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 7/12] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:51:35 2022] GET /compute/v2.1/os-volumes/b98eab2e-5f88-4b56-885b-af2f9277ec6a => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:51:35.751550 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6ed7a33a-0fa2-42a0-973f-10a1abfa62a9 tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] Calling method '.version_select at 0x7ff92f2028b0>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:35.860322 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-faee1b2e-119d-43f6-8e79-69a0e8b4c3b1 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f330e50>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:35.957345 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6ed7a33a-0fa2-42a0-973f-10a1abfa62a9 tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1993557e-7516-4074-9804-e88607a0d2ff" status: 200 len: 354 microversion: 2.1 time: 0.211677 Oct 04 08:51:35.958054 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 6/13] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:51:35 2022] GET /compute/v2.1/os-volumes/1993557e-7516-4074-9804-e88607a0d2ff => generated 354 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:35.975573 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ddac3f5c-2ac7-45c3-8848-f79a15fad8d1 tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] Calling method '.version_select at 0x7ff92fb5d940>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:36.022829 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-faee1b2e-119d-43f6-8e79-69a0e8b4c3b1 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627" status: 200 len: 346 microversion: 2.1 time: 0.167101 Oct 04 08:51:36.024182 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 8/14] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:51:35 2022] GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627 => generated 346 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:36.040069 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-938f19d5-e7fb-489c-af09-49a2faeaebd8 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Action: 'create', calling method: .version_select at 0x7ff92f126af0>, body: {"snapshot": {"volume_id": "cb277e01-aac2-4fbc-bd38-0036f3e83627", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1435344125"}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:36.125552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ddac3f5c-2ac7-45c3-8848-f79a15fad8d1 tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1993557e-7516-4074-9804-e88607a0d2ff" status: 200 len: 354 microversion: 2.1 time: 0.156480 Oct 04 08:51:36.141866 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 7/15] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:51:35 2022] GET /compute/v2.1/os-volumes/1993557e-7516-4074-9804-e88607a0d2ff => generated 354 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:36.151632 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1e9ece2e-40d6-401a-b513-75c9a1e23e78 tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] Calling method '.version_select at 0x7ff92f18b820>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:36.343169 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1e9ece2e-40d6-401a-b513-75c9a1e23e78 tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/1993557e-7516-4074-9804-e88607a0d2ff" status: 202 len: 0 microversion: 2.1 time: 0.195575 Oct 04 08:51:36.348065 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 8/16] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Oct 4 08:51:36 2022] DELETE /compute/v2.1/os-volumes/1993557e-7516-4074-9804-e88607a0d2ff => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:51:36.354837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2844cc13-77a9-4b0d-b4f6-9ca6d79e7023 tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] Calling method '.version_select at 0x7ff92f18bee0>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:36.443078 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-938f19d5-e7fb-489c-af09-49a2faeaebd8 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.409686 Oct 04 08:51:36.443588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 9/17] 10.222.0.44 () {60 vars in 1162 bytes} [Tue Oct 4 08:51:36 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:51:36.459053 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1a732e4d-59b6-49b2-9d5a-269cf4bde2a4 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f12f700>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:36.477683 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2844cc13-77a9-4b0d-b4f6-9ca6d79e7023 tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1993557e-7516-4074-9804-e88607a0d2ff" status: 200 len: 353 microversion: 2.1 time: 0.128355 Oct 04 08:51:36.478255 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 9/18] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:51:36 2022] GET /compute/v2.1/os-volumes/1993557e-7516-4074-9804-e88607a0d2ff => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:36.635425 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1a732e4d-59b6-49b2-9d5a-269cf4bde2a4 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f" status: 200 len: 287 microversion: 2.1 time: 0.182870 Oct 04 08:51:36.636938 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 10/19] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Oct 4 08:51:36 2022] GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f => generated 287 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:51:36.658328 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fb3f2b44-8e0c-471f-b433-f65861d78951 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f18b790>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:36.809722 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fb3f2b44-8e0c-471f-b433-f65861d78951 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.163555 Oct 04 08:51:36.810283 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 10/20] 10.222.0.44 () {58 vars in 1140 bytes} [Tue Oct 4 08:51:36 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:36.825392 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-957463e5-9f07-4a1c-b531-8ad69759604b tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f12fe50>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:36.995013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-957463e5-9f07-4a1c-b531-8ad69759604b tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f" status: 200 len: 287 microversion: 2.1 time: 0.176536 Oct 04 08:51:36.996321 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 11/21] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Oct 4 08:51:36 2022] GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f => generated 287 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:37.493089 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5fd22f05-5440-4f7c-8e56-971e45a3c9e6 tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] Calling method '.version_select at 0x7ff92f2023a0>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:37.572318 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-5fd22f05-5440-4f7c-8e56-971e45a3c9e6 tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] HTTP exception thrown: Volume 1993557e-7516-4074-9804-e88607a0d2ff could not be found. Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5fd22f05-5440-4f7c-8e56-971e45a3c9e6 tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] Request method failure captured: Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/os-volumes/1993557e-7516-4074-9804-e88607a0d2ff HTTP/1.1 Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_QS6hOhGBMoJMAJDB2LnR-Wxe2LLzOPvkRzFuoW8fr_7-spNwhQAoto5BpkuGNXtroqRNn7k4GlEw35wJ2CJin9pqeyFWpRdnnnJg1vggwoAUjKMYDCYHxPifEJditfo2323v0HeOa2BzKxSkDLoeUB_dwaFclivoeY2udyPULagoc Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 269445aa5f0745a4ac2eff02524fbcc0 Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-VolumesGetTestJSON-1874317075 Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 08:51:37.575114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 08:51:37.576162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_269445aa5f0745a4ac2eff02524fbcc0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/269445aa5f0745a4ac2eff02524fbcc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/269445aa5f0745a4ac2eff02524fbcc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/269445aa5f0745a4ac2eff02524fbcc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:51:37.576162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-VolumesGetTestJSON-1874317075 Oct 04 08:51:37.576162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 269445aa5f0745a4ac2eff02524fbcc0 Oct 04 08:51:37.576162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-VolumesGetTestJSON-1874317075 Oct 04 08:51:37.576162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-VolumesGetTestJSON-1874317075-project Oct 04 08:51:37.576162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 08:51:37.576162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 08:51:37.576162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: a2b91a1c4acc4cc88cd98a3215ebcc98 Oct 04 08:51:37.576162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-VolumesGetTestJSON-1874317075-project Oct 04 08:51:37.576162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: Oct 04 08:51:37.576162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Volume 1993557e-7516-4074-9804-e88607a0d2ff could not be found. Oct 04 08:51:37.576162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': '1993557e-7516-4074-9804-e88607a0d2ff'} Oct 04 08:51:37.576162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1993557e-7516-4074-9804-e88607a0d2ff could not be found. (HTTP 404) (Request-ID: req-80c8904c-585d-49b7-9e23-4eebecf860f0) Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:37.576808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:51:37.577737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1993557e-7516-4074-9804-e88607a0d2ff could not be found. Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 08:51:37.579090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:51:37.580298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1993557e-7516-4074-9804-e88607a0d2ff could not be found. Oct 04 08:51:37.580298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:37.580298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:37.580298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:37.580298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:37.580298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:37.580298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:37.580298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:51:37.580298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:51:37.580298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1993557e-7516-4074-9804-e88607a0d2ff could not be found. Oct 04 08:51:37.580298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:37.580298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5fd22f05-5440-4f7c-8e56-971e45a3c9e6 tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] Returning 404 to user: Volume 1993557e-7516-4074-9804-e88607a0d2ff could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:37.580298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5fd22f05-5440-4f7c-8e56-971e45a3c9e6 tempest-VolumesGetTestJSON-1874317075 tempest-VolumesGetTestJSON-1874317075-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1993557e-7516-4074-9804-e88607a0d2ff" status: 404 len: 109 microversion: 2.1 time: 0.087732 Oct 04 08:51:37.580298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 11/22] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:51:37 2022] GET /compute/v2.1/os-volumes/1993557e-7516-4074-9804-e88607a0d2ff => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:51:38.008246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2fb3ba0d-5324-4ad6-97ab-f11b23217213 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f12f700>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:38.062657 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2fb3ba0d-5324-4ad6-97ab-f11b23217213 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f" status: 200 len: 287 microversion: 2.1 time: 0.058167 Oct 04 08:51:38.063979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 12/23] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Oct 4 08:51:38 2022] GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:39.078273 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-57142518-102d-46ca-852e-47bd9aedd6f6 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f202550>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:39.148355 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-57142518-102d-46ca-852e-47bd9aedd6f6 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f" status: 200 len: 287 microversion: 2.1 time: 0.075213 Oct 04 08:51:39.150365 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 12/24] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Oct 4 08:51:39 2022] GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:40.176747 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-89659afb-8a17-4d5c-8859-8cd1ace64f00 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f1268b0>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:40.266828 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-89659afb-8a17-4d5c-8859-8cd1ace64f00 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f" status: 200 len: 287 microversion: 2.1 time: 0.103525 Oct 04 08:51:40.270788 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 13/25] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Oct 4 08:51:40 2022] GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:41.282266 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1552e333-4bcc-4a6e-aedb-51c158ef6e95 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92fb5d8b0>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:41.353089 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1552e333-4bcc-4a6e-aedb-51c158ef6e95 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f" status: 200 len: 287 microversion: 2.1 time: 0.074447 Oct 04 08:51:41.354943 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 13/26] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Oct 4 08:51:41 2022] GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:42.087998 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1506565757", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "networks": [{"uuid": "53dbf561-4ad7-404c-bd7a-8074ad2296fd"}]}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:42.252623 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.network.neutron [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] validate_networks() for [('53dbf561-4ad7-404c-bd7a-8074ad2296fd', None, None, None, None, None)] {{(pid=142438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:51:42.368167 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0b8fa1b3-f56a-4c88-957f-bdb6aa97f290 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f18baf0>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:42.428331 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0b8fa1b3-f56a-4c88-957f-bdb6aa97f290 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f" status: 200 len: 287 microversion: 2.1 time: 0.065034 Oct 04 08:51:42.428895 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 14/27] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Oct 4 08:51:42 2022] GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:43.449502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b0679c1e-7208-45de-90be-fc5b534d186f tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f127040>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:43.576117 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b0679c1e-7208-45de-90be-fc5b534d186f tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f" status: 200 len: 288 microversion: 2.1 time: 0.138900 Oct 04 08:51:43.576711 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 15/28] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Oct 4 08:51:43 2022] GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f => generated 288 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:43.589761 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-027bb162-6a8c-41c9-8366-11d241d2da5b tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f127700>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:43.865768 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-027bb162-6a8c-41c9-8366-11d241d2da5b tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f" status: 202 len: 0 microversion: 2.1 time: 0.281193 Oct 04 08:51:43.867050 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 16/29] 10.222.0.44 () {58 vars in 1254 bytes} [Tue Oct 4 08:51:43 2022] DELETE /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:51:43.875283 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-cb63097b-c4ed-41fe-9f04-8d5c1ac82693 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f18bc10>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:43.954142 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Flavor limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:51:43.955143 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Image limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:51:43.955618 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Flavor pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:51:43.956077 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Image pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:51:43.956491 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:51:44.024772 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:44.025277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:44.025708 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:44.026444 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:44.044227 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:44.049961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:44.071164 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-cb63097b-c4ed-41fe-9f04-8d5c1ac82693 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f" status: 200 len: 287 microversion: 2.1 time: 0.200232 Oct 04 08:51:44.072026 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 17/30] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Oct 4 08:51:43 2022] GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f => generated 287 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:51:44.160712 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Getting quotas for project 0c4d8cf4a0b74162b6f73a0b2d88ff09. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:51:44.186365 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Getting quotas for user 91ccd41938954a36adb45c70e6ff41de and project 0c4d8cf4a0b74162b6f73a0b2d88ff09. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:51:44.218004 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Going to run 1 instances... {{(pid=142438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:51:44.231717 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:51:44.512935 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7228614a-5287-472b-8da2-566dc2d07f94 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.603822 Oct 04 08:51:44.521149 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 14/31] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 08:51:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:51:44.534902 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-be41ccfc-4015-49b0-8b64-38069adc4ac7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:44.536705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-be41ccfc-4015-49b0-8b64-38069adc4ac7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:44.776691 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-be41ccfc-4015-49b0-8b64-38069adc4ac7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:44.812268 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-be41ccfc-4015-49b0-8b64-38069adc4ac7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1215 microversion: 2.1 time: 0.280618 Oct 04 08:51:44.813253 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 18/32] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:44 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1215 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:51:45.085727 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-18015045-8b52-4720-bc38-13e3b23a3490 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f1278b0>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:45.137131 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-18015045-8b52-4720-bc38-13e3b23a3490 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] HTTP exception thrown: Snapshot 81af83fb-785c-4711-b7d8-4a4f9042595f could not be found. Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-18015045-8b52-4720-bc38-13e3b23a3490 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Request method failure captured: Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f HTTP/1.1 Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_QTgRBz3jpqpc64v-vXl5xd1TbUwqVUlL9F21WqVb3am81g0zdXiMMUOouZG4CoUf7P00M0YF22dmPu8Wtm1ID-ak3Pbdv5pjq2aJytUPnMZBYobs-UeqAdW4b7xHf_2NSBdt4w3Xp6znE0P0pPEACG0FAmM8RIk3H_SKmW7KIFCKk Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 6d0f2821338a4628882790d108bfe02c Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1492888055 Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 08:51:45.139985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 08:51:45.141222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6d0f2821338a4628882790d108bfe02c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6d0f2821338a4628882790d108bfe02c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d0f2821338a4628882790d108bfe02c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d0f2821338a4628882790d108bfe02c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:51:45.141222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1492888055 Oct 04 08:51:45.141222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 6d0f2821338a4628882790d108bfe02c Oct 04 08:51:45.141222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1492888055 Oct 04 08:51:45.141222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-VolumesSnapshotsTestJSON-1492888055-project Oct 04 08:51:45.141222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 08:51:45.141222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 08:51:45.141222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: b21bed13f7594ecbaf2194172abcfe8c Oct 04 08:51:45.141222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1492888055-project Oct 04 08:51:45.141222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: Oct 04 08:51:45.141222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Snapshot 81af83fb-785c-4711-b7d8-4a4f9042595f could not be found. Oct 04 08:51:45.141222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': '81af83fb-785c-4711-b7d8-4a4f9042595f'} Oct 04 08:51:45.141222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 81af83fb-785c-4711-b7d8-4a4f9042595f could not be found. (HTTP 404) (Request-ID: req-2a4ec6e3-b223-4098-a418-d21d788ed328) Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:45.142108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:51:45.143146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 81af83fb-785c-4711-b7d8-4a4f9042595f could not be found. Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 08:51:45.145140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:51:45.146834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 81af83fb-785c-4711-b7d8-4a4f9042595f could not be found. Oct 04 08:51:45.146834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:45.146834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:45.146834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:45.146834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:45.146834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:45.146834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:45.146834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:51:45.146834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:51:45.146834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 81af83fb-785c-4711-b7d8-4a4f9042595f could not be found. Oct 04 08:51:45.146834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:51:45.149719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-18015045-8b52-4720-bc38-13e3b23a3490 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Returning 404 to user: Snapshot 81af83fb-785c-4711-b7d8-4a4f9042595f could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:45.152069 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-18015045-8b52-4720-bc38-13e3b23a3490 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f" status: 404 len: 111 microversion: 2.1 time: 0.071095 Oct 04 08:51:45.154071 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 19/33] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Oct 4 08:51:45 2022] GET /compute/v2.1/os-snapshots/81af83fb-785c-4711-b7d8-4a4f9042595f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:51:45.168316 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-42c6c8b2-b972-492b-a2e7-e983e3c1af80 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f0fc160>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:45.337990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-42c6c8b2-b972-492b-a2e7-e983e3c1af80 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627" status: 202 len: 0 microversion: 2.1 time: 0.179467 Oct 04 08:51:45.338836 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 20/34] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Oct 4 08:51:45 2022] DELETE /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:51:45.347625 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1bf99286-17ef-42f8-b950-1e9e3512b7c1 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f0e5ca0>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:45.494583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1bf99286-17ef-42f8-b950-1e9e3512b7c1 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627" status: 200 len: 345 microversion: 2.1 time: 0.151560 Oct 04 08:51:45.499992 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 21/35] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:51:45 2022] GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627 => generated 345 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:51:45.800930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1657112215", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:45.844286 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8b472211-0c57-4f8f-b3ad-87b5d1391900 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:45.844902 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8b472211-0c57-4f8f-b3ad-87b5d1391900 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:45.929296 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.network.neutron [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] validate_networks() for [('9d6644cc-03e9-4e6d-b6f1-c27cc0c7c185', None, None, None, None, None)] {{(pid=142438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:51:46.233430 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8b472211-0c57-4f8f-b3ad-87b5d1391900 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:46.243830 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8b472211-0c57-4f8f-b3ad-87b5d1391900 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1215 microversion: 2.1 time: 0.404270 Oct 04 08:51:46.246673 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 22/36] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:45 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1215 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:51:46.507426 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c251e519-cf2b-4099-a7f4-a3ad1d3437ce tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Action: 'create', calling method: .version_select at 0x7ff92f127790>, body: {"keypair": {"name": "tempest-keypair-1152232857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHgIybJz0Y7KlsHoi1fz5sFxVGRlOBJMHAVaNNVjrwuOSllyAfPV9q27mgez+AjaRQBdT1f92zwSnr7cZaYGpXB1NSaAxNPFkaLWw2Lxyzw4eq9A0mzrJixP5/6E9Q1vQ=="}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:46.599523 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-c251e519-cf2b-4099-a7f4-a3ad1d3437ce tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Getting quotas for project d255b03b31004c3b8e446f318cd72265. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:51:46.614999 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-c251e519-cf2b-4099-a7f4-a3ad1d3437ce tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Getting quotas for user 68288f4e2f57454fbb06eff0dd72cca3 and project d255b03b31004c3b8e446f318cd72265. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:51:46.718922 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c251e519-cf2b-4099-a7f4-a3ad1d3437ce tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.344311 Oct 04 08:51:46.721966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 23/37] 10.222.0.44 () {62 vars in 1200 bytes} [Tue Oct 4 08:51:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 348 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 08:51:46.733013 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-880ca32b-6d8b-414e-9753-b1f6c3a1846d tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f055670>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:46.849926 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-880ca32b-6d8b-414e-9753-b1f6c3a1846d tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627" status: 200 len: 345 microversion: 2.1 time: 0.126578 Oct 04 08:51:46.855531 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 24/38] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:51:46 2022] GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627 => generated 345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:47.275116 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-7ac97110-5894-486d-a93b-ead4e6145923 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:47.275779 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-7ac97110-5894-486d-a93b-ead4e6145923 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:47.285322 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7ac97110-5894-486d-a93b-ead4e6145923 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:47.287653 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7ac97110-5894-486d-a93b-ead4e6145923 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:47.290338 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7ac97110-5894-486d-a93b-ead4e6145923 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:47.291304 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7ac97110-5894-486d-a93b-ead4e6145923 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:47.292235 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7ac97110-5894-486d-a93b-ead4e6145923 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:47.294557 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7ac97110-5894-486d-a93b-ead4e6145923 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:47.572662 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Flavor limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:51:47.574074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Image limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:51:47.575169 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Flavor pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:51:47.575971 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Image pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:51:47.576773 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:51:47.598686 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:47.600807 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:47.602699 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:47.604551 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:47.606606 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:47.608573 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:47.701867 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Getting quotas for project ba66b134261b494b964e9f050449a0fe. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:51:47.712060 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Getting quotas for user 1d22ff09fb6743c2880af0d7778fb984 and project ba66b134261b494b964e9f050449a0fe. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:51:47.731614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7ac97110-5894-486d-a93b-ead4e6145923 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:47.735385 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Going to run 1 instances... {{(pid=142438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:51:47.742585 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:51:47.765950 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-7ac97110-5894-486d-a93b-ead4e6145923 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1219 microversion: 2.1 time: 0.491020 Oct 04 08:51:47.780969 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 25/39] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:47 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1219 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:51:47.870704 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a733aa84-c6d9-413c-8ec4-05b796c087d8 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92effdca0>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:47.887089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5fddca95-1b70-455b-9d81-2e227fa4fdd4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.908575 Oct 04 08:51:47.897267 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 15/40] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 08:51:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 2923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:51:47.908091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-61f13b87-07ff-4687-a564-960304349fb2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:47.909510 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-61f13b87-07ff-4687-a564-960304349fb2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:48.062342 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a733aa84-c6d9-413c-8ec4-05b796c087d8 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627" status: 200 len: 345 microversion: 2.1 time: 0.196642 Oct 04 08:51:48.062976 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 26/41] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:51:47 2022] GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627 => generated 345 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:48.146059 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-61f13b87-07ff-4687-a564-960304349fb2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:48.180909 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-61f13b87-07ff-4687-a564-960304349fb2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1222 microversion: 2.1 time: 0.280227 Oct 04 08:51:48.206084 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 16/42] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:47 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1222 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:48.457708 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1788227400", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:48.731604 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.network.neutron [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] validate_networks() for [('9d6644cc-03e9-4e6d-b6f1-c27cc0c7c185', None, None, None, None, None)] {{(pid=142439) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:51:48.791727 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d518c8e7-b5bb-4c04-b81e-6181cc8e95a8 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:48.793692 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d518c8e7-b5bb-4c04-b81e-6181cc8e95a8 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:48.817386 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d518c8e7-b5bb-4c04-b81e-6181cc8e95a8 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:48.819053 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d518c8e7-b5bb-4c04-b81e-6181cc8e95a8 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:48.820448 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d518c8e7-b5bb-4c04-b81e-6181cc8e95a8 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:48.823153 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d518c8e7-b5bb-4c04-b81e-6181cc8e95a8 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:48.823835 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d518c8e7-b5bb-4c04-b81e-6181cc8e95a8 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:48.825030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d518c8e7-b5bb-4c04-b81e-6181cc8e95a8 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:49.059630 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d518c8e7-b5bb-4c04-b81e-6181cc8e95a8 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:49.083684 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d518c8e7-b5bb-4c04-b81e-6181cc8e95a8 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1219 microversion: 2.1 time: 0.296887 Oct 04 08:51:49.084328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 17/43] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:48 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1219 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:49.110210 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-fa1a98cd-4766-4732-8a74-2117562580bc tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92e768ca0>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:49.220917 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-fa1a98cd-4766-4732-8a74-2117562580bc tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627" status: 200 len: 345 microversion: 2.1 time: 0.128560 Oct 04 08:51:49.221497 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 18/44] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:51:49 2022] GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627 => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:50.111373 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-cac0813c-ef7a-4e99-9480-b35d76bf7d41 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:50.112662 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cac0813c-ef7a-4e99-9480-b35d76bf7d41 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:50.137671 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cac0813c-ef7a-4e99-9480-b35d76bf7d41 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:50.140850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cac0813c-ef7a-4e99-9480-b35d76bf7d41 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:50.141515 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cac0813c-ef7a-4e99-9480-b35d76bf7d41 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:50.144477 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cac0813c-ef7a-4e99-9480-b35d76bf7d41 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:50.150641 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cac0813c-ef7a-4e99-9480-b35d76bf7d41 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:50.152073 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cac0813c-ef7a-4e99-9480-b35d76bf7d41 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:50.382298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cac0813c-ef7a-4e99-9480-b35d76bf7d41 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:50.409280 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-cac0813c-ef7a-4e99-9480-b35d76bf7d41 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1267 microversion: 2.1 time: 0.305247 Oct 04 08:51:50.419496 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 19/45] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:50 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1267 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:51:50.441029 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b877f0ef-e6a5-46a0-970b-231ef9fadd76 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92e768e50>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:50.479673 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Flavor limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:51:50.480252 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Image limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:51:50.481014 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Flavor pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:51:50.481825 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Image pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:51:50.483998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:51:50.499652 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:50.500630 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:50.501590 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:50.502873 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:50.503575 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:50.504230 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:50.528794 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-b877f0ef-e6a5-46a0-970b-231ef9fadd76 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] HTTP exception thrown: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b877f0ef-e6a5-46a0-970b-231ef9fadd76 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Request method failure captured: Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627 HTTP/1.1 Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_QTgRBz3jpqpc64v-vXl5xd1TbUwqVUlL9F21WqVb3am81g0zdXiMMUOouZG4CoUf7P00M0YF22dmPu8Wtm1ID-ak3Pbdv5pjq2aJytUPnMZBYobs-UeqAdW4b7xHf_2NSBdt4w3Xp6znE0P0pPEACG0FAmM8RIk3H_SKmW7KIFCKk Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 6d0f2821338a4628882790d108bfe02c Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1492888055 Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 08:51:50.531655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 08:51:50.533023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6d0f2821338a4628882790d108bfe02c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6d0f2821338a4628882790d108bfe02c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d0f2821338a4628882790d108bfe02c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d0f2821338a4628882790d108bfe02c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:51:50.533023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1492888055 Oct 04 08:51:50.533023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 6d0f2821338a4628882790d108bfe02c Oct 04 08:51:50.533023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1492888055 Oct 04 08:51:50.533023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-VolumesSnapshotsTestJSON-1492888055-project Oct 04 08:51:50.533023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 08:51:50.533023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 08:51:50.533023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: b21bed13f7594ecbaf2194172abcfe8c Oct 04 08:51:50.533023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1492888055-project Oct 04 08:51:50.533023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: Oct 04 08:51:50.533023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. Oct 04 08:51:50.533023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': 'cb277e01-aac2-4fbc-bd38-0036f3e83627'} Oct 04 08:51:50.533023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. (HTTP 404) (Request-ID: req-14a7c7ba-5382-48a3-99a2-45ec8453c195) Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:50.533737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:51:50.534736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 08:51:50.535840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:51:50.536961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. Oct 04 08:51:50.536961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.536961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:50.536961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.536961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:50.536961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:50.536961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:50.536961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:51:50.536961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:51:50.536961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. Oct 04 08:51:50.536961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.539619 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b877f0ef-e6a5-46a0-970b-231ef9fadd76 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Returning 404 to user: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:50.540824 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b877f0ef-e6a5-46a0-970b-231ef9fadd76 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627" status: 404 len: 109 microversion: 2.1 time: 0.118918 Oct 04 08:51:50.541487 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 20/46] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:51:50 2022] GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:51:50.557804 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Getting quotas for project ba66b134261b494b964e9f050449a0fe. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:51:50.559992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d8e70908-c9fb-4045-a0c3-b087b9c6f88c tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92f12fd30>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:50.568997 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Getting quotas for user 1d22ff09fb6743c2880af0d7778fb984 and project ba66b134261b494b964e9f050449a0fe. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:51:50.589555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Going to run 1 instances... {{(pid=142439) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:51:50.602762 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:51:50.631619 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-d8e70908-c9fb-4045-a0c3-b087b9c6f88c tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] HTTP exception thrown: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d8e70908-c9fb-4045-a0c3-b087b9c6f88c tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Request method failure captured: Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: DELETE /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627 HTTP/1.1 Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_QTgRBz3jpqpc64v-vXl5xd1TbUwqVUlL9F21WqVb3am81g0zdXiMMUOouZG4CoUf7P00M0YF22dmPu8Wtm1ID-ak3Pbdv5pjq2aJytUPnMZBYobs-UeqAdW4b7xHf_2NSBdt4w3Xp6znE0P0pPEACG0FAmM8RIk3H_SKmW7KIFCKk Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 6d0f2821338a4628882790d108bfe02c Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1492888055 Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 08:51:50.638199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 08:51:50.639505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6d0f2821338a4628882790d108bfe02c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6d0f2821338a4628882790d108bfe02c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d0f2821338a4628882790d108bfe02c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d0f2821338a4628882790d108bfe02c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:51:50.639505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1492888055 Oct 04 08:51:50.639505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 6d0f2821338a4628882790d108bfe02c Oct 04 08:51:50.639505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1492888055 Oct 04 08:51:50.639505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-VolumesSnapshotsTestJSON-1492888055-project Oct 04 08:51:50.639505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 08:51:50.639505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 08:51:50.639505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: b21bed13f7594ecbaf2194172abcfe8c Oct 04 08:51:50.639505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1492888055-project Oct 04 08:51:50.639505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: Oct 04 08:51:50.639505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. Oct 04 08:51:50.639505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': 'cb277e01-aac2-4fbc-bd38-0036f3e83627'} Oct 04 08:51:50.639505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. (HTTP 404) (Request-ID: req-e92b1e92-ff79-470e-80c0-4752ee870977) Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:50.640250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:51:50.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 08:51:50.642039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:51:50.643095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. Oct 04 08:51:50.643095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.643095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:50.643095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.643095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:50.643095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:50.643095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:50.643095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:51:50.643095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:51:50.643095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. Oct 04 08:51:50.643095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.643095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d8e70908-c9fb-4045-a0c3-b087b9c6f88c tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Returning 404 to user: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:50.643095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d8e70908-c9fb-4045-a0c3-b087b9c6f88c tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627" status: 404 len: 109 microversion: 2.1 time: 0.092364 Oct 04 08:51:50.643875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 21/47] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Oct 4 08:51:50 2022] DELETE /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:51:50.655668 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-24a357ce-0b5c-4585-b772-3c6414470100 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Calling method '.version_select at 0x7ff92e768550>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:50.732762 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-24a357ce-0b5c-4585-b772-3c6414470100 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] HTTP exception thrown: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-24a357ce-0b5c-4585-b772-3c6414470100 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Request method failure captured: Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627 HTTP/1.1 Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_QTgRBz3jpqpc64v-vXl5xd1TbUwqVUlL9F21WqVb3am81g0zdXiMMUOouZG4CoUf7P00M0YF22dmPu8Wtm1ID-ak3Pbdv5pjq2aJytUPnMZBYobs-UeqAdW4b7xHf_2NSBdt4w3Xp6znE0P0pPEACG0FAmM8RIk3H_SKmW7KIFCKk Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 6d0f2821338a4628882790d108bfe02c Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1492888055 Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 08:51:50.736021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 08:51:50.737509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6d0f2821338a4628882790d108bfe02c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6d0f2821338a4628882790d108bfe02c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d0f2821338a4628882790d108bfe02c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d0f2821338a4628882790d108bfe02c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:51:50.737509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1492888055 Oct 04 08:51:50.737509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 6d0f2821338a4628882790d108bfe02c Oct 04 08:51:50.737509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1492888055 Oct 04 08:51:50.737509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-VolumesSnapshotsTestJSON-1492888055-project Oct 04 08:51:50.737509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 08:51:50.737509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 08:51:50.737509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: b21bed13f7594ecbaf2194172abcfe8c Oct 04 08:51:50.737509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1492888055-project Oct 04 08:51:50.737509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: Oct 04 08:51:50.737509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. Oct 04 08:51:50.737509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': 'cb277e01-aac2-4fbc-bd38-0036f3e83627'} Oct 04 08:51:50.737509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. (HTTP 404) (Request-ID: req-61eb3cc8-2e1e-4db1-adc6-95de2aeacdb6) Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:50.738224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:51:50.739277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 08:51:50.740345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:51:50.741257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. Oct 04 08:51:50.741257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.741257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:50.741257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.741257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:50.741257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:50.741257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:50.741257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:51:50.741257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:51:50.741257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. Oct 04 08:51:50.741257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:51:50.741257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-24a357ce-0b5c-4585-b772-3c6414470100 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] Returning 404 to user: Volume cb277e01-aac2-4fbc-bd38-0036f3e83627 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:50.741257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-24a357ce-0b5c-4585-b772-3c6414470100 tempest-VolumesSnapshotsTestJSON-1492888055 tempest-VolumesSnapshotsTestJSON-1492888055-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627" status: 404 len: 109 microversion: 2.1 time: 0.093271 Oct 04 08:51:50.741257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 22/48] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:51:50 2022] GET /compute/v2.1/os-volumes/cb277e01-aac2-4fbc-bd38-0036f3e83627 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:51:50.778288 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ff71a97f-20e3-4a50-8166-7c6b31c597e3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.326191 Oct 04 08:51:50.790360 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 27/49] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 08:51:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 2339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:51:50.799978 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9a2a120c-8958-4723-a406-995052bc8e5a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:50.800710 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9a2a120c-8958-4723-a406-995052bc8e5a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:51.253541 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9a2a120c-8958-4723-a406-995052bc8e5a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:51.269229 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-9a2a120c-8958-4723-a406-995052bc8e5a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1222 microversion: 2.1 time: 0.471378 Oct 04 08:51:51.270673 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 23/50] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:50 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1222 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:51.436843 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c5848978-65e3-441a-b05a-dd1e72c5f498 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:51.437804 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c5848978-65e3-441a-b05a-dd1e72c5f498 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:51.471525 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c5848978-65e3-441a-b05a-dd1e72c5f498 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:51.471525 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c5848978-65e3-441a-b05a-dd1e72c5f498 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:51.471525 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c5848978-65e3-441a-b05a-dd1e72c5f498 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:51.471525 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c5848978-65e3-441a-b05a-dd1e72c5f498 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:51.472133 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c5848978-65e3-441a-b05a-dd1e72c5f498 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:51.472133 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c5848978-65e3-441a-b05a-dd1e72c5f498 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:51.731527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c5848978-65e3-441a-b05a-dd1e72c5f498 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:51.740496 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c5848978-65e3-441a-b05a-dd1e72c5f498 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1273 microversion: 2.1 time: 0.308887 Oct 04 08:51:51.741148 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 28/51] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:51 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1273 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:52.079781 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1728932560", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b6df89b-d877-47b3-92a7-e51799baa62f"}], "security_groups": [{"name": "tempest-securitygroup--393661610"}], "key_name": "tempest-keypair-1152232857", "user_data": "}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:52.298575 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c86ebc65-2cc3-4de5-9126-6e2acfc77607 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:52.298792 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c86ebc65-2cc3-4de5-9126-6e2acfc77607 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:52.313112 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c86ebc65-2cc3-4de5-9126-6e2acfc77607 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:52.313610 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c86ebc65-2cc3-4de5-9126-6e2acfc77607 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:52.314062 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c86ebc65-2cc3-4de5-9126-6e2acfc77607 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:52.314747 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c86ebc65-2cc3-4de5-9126-6e2acfc77607 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:52.315198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c86ebc65-2cc3-4de5-9126-6e2acfc77607 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:52.315618 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c86ebc65-2cc3-4de5-9126-6e2acfc77607 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:53.331035 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c86ebc65-2cc3-4de5-9126-6e2acfc77607 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:53.348279 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c86ebc65-2cc3-4de5-9126-6e2acfc77607 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1218 microversion: 2.1 time: 1.055819 Oct 04 08:51:53.348872 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 29/52] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:52 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1218 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:53.353502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a32c28bd-b711-4a2b-8f7a-8c681f49594f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:53.354106 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a32c28bd-b711-4a2b-8f7a-8c681f49594f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:53.402270 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a32c28bd-b711-4a2b-8f7a-8c681f49594f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:53.410059 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a32c28bd-b711-4a2b-8f7a-8c681f49594f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:53.410742 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a32c28bd-b711-4a2b-8f7a-8c681f49594f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:53.411580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a32c28bd-b711-4a2b-8f7a-8c681f49594f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:53.412020 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a32c28bd-b711-4a2b-8f7a-8c681f49594f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:53.412444 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a32c28bd-b711-4a2b-8f7a-8c681f49594f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:53.546348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.network.neutron [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] validate_networks() for [('4b6df89b-d877-47b3-92a7-e51799baa62f', None, None, None, None, None)] {{(pid=142438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:51:54.181745 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a32c28bd-b711-4a2b-8f7a-8c681f49594f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:54.197028 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a32c28bd-b711-4a2b-8f7a-8c681f49594f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1273 microversion: 2.1 time: 0.847025 Oct 04 08:51:54.203122 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 30/53] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:53 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1273 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:54.391670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-83a1419e-f144-436a-b527-281b35c6ddca tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:54.394961 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-83a1419e-f144-436a-b527-281b35c6ddca tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:54.402259 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-83a1419e-f144-436a-b527-281b35c6ddca tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:54.405429 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-83a1419e-f144-436a-b527-281b35c6ddca tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:54.406971 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-83a1419e-f144-436a-b527-281b35c6ddca tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:54.408779 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-83a1419e-f144-436a-b527-281b35c6ddca tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:54.409601 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-83a1419e-f144-436a-b527-281b35c6ddca tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:54.415413 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-83a1419e-f144-436a-b527-281b35c6ddca tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:54.602509 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-83a1419e-f144-436a-b527-281b35c6ddca tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:54.619877 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-83a1419e-f144-436a-b527-281b35c6ddca tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1280 microversion: 2.1 time: 0.239071 Oct 04 08:51:54.623078 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 31/54] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:54 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1280 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:55.232628 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-715539fd-cc9b-494f-9957-226459650cd7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:55.234366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-715539fd-cc9b-494f-9957-226459650cd7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:55.263229 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-715539fd-cc9b-494f-9957-226459650cd7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:55.272098 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-715539fd-cc9b-494f-9957-226459650cd7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:55.272603 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-715539fd-cc9b-494f-9957-226459650cd7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:55.278678 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-715539fd-cc9b-494f-9957-226459650cd7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:55.279424 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-715539fd-cc9b-494f-9957-226459650cd7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:55.280656 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-715539fd-cc9b-494f-9957-226459650cd7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:56.279007 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-715539fd-cc9b-494f-9957-226459650cd7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:56.293204 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Flavor limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:51:56.293204 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Image limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:51:56.293789 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Flavor pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:51:56.295035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Image pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:51:56.295460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:51:56.308951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-715539fd-cc9b-494f-9957-226459650cd7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 1.086349 Oct 04 08:51:56.311717 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:56.311960 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 32/55] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:55 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:56.312703 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:56.313447 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:56.314518 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:56.321080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e1525fdc-5715-4235-9c7d-692c9e6f71d5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:56.321709 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e1525fdc-5715-4235-9c7d-692c9e6f71d5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:56.332697 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:56.335121 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:56.335938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e1525fdc-5715-4235-9c7d-692c9e6f71d5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:56.336731 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e1525fdc-5715-4235-9c7d-692c9e6f71d5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:56.337230 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e1525fdc-5715-4235-9c7d-692c9e6f71d5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:56.337944 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e1525fdc-5715-4235-9c7d-692c9e6f71d5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:56.338400 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e1525fdc-5715-4235-9c7d-692c9e6f71d5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:56.338823 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e1525fdc-5715-4235-9c7d-692c9e6f71d5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:56.372001 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Getting quotas for project d255b03b31004c3b8e446f318cd72265. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:51:56.380755 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Getting quotas for user 68288f4e2f57454fbb06eff0dd72cca3 and project d255b03b31004c3b8e446f318cd72265. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:51:56.396742 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Going to run 1 instances... {{(pid=142438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:51:56.400194 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:51:56.565155 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f4d58e4d-188b-40eb-b099-3704e113db30 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.489352 Oct 04 08:51:56.567463 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 24/56] 10.222.0.44 () {62 vars in 1188 bytes} [Tue Oct 4 08:51:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 4493 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 08:51:56.606595 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-59cc1c0d-7b55-46fe-b2eb-67c888e11d56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:56.609414 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-59cc1c0d-7b55-46fe-b2eb-67c888e11d56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:56.834264 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-59cc1c0d-7b55-46fe-b2eb-67c888e11d56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:56.846257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-59cc1c0d-7b55-46fe-b2eb-67c888e11d56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:56.856477 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-59cc1c0d-7b55-46fe-b2eb-67c888e11d56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:56.865657 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-59cc1c0d-7b55-46fe-b2eb-67c888e11d56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1282 microversion: 2.20 time: 0.282993 Oct 04 08:51:56.868280 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 25/57] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:51:56 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1282 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:51:56.949105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e1525fdc-5715-4235-9c7d-692c9e6f71d5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:56.967086 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e1525fdc-5715-4235-9c7d-692c9e6f71d5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.652178 Oct 04 08:51:56.973539 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 33/58] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:56 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:57.335016 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-65123cd8-fc85-44ab-8738-374931ae25db tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:57.335654 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-65123cd8-fc85-44ab-8738-374931ae25db tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:57.346973 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65123cd8-fc85-44ab-8738-374931ae25db tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:57.347475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65123cd8-fc85-44ab-8738-374931ae25db tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:57.351435 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65123cd8-fc85-44ab-8738-374931ae25db tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:57.354272 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65123cd8-fc85-44ab-8738-374931ae25db tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:57.355938 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65123cd8-fc85-44ab-8738-374931ae25db tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:57.356354 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65123cd8-fc85-44ab-8738-374931ae25db tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:57.899394 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-59d85ae4-2305-4e7e-acdc-af98687c9e40 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:57.900010 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-59d85ae4-2305-4e7e-acdc-af98687c9e40 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:57.917241 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-59d85ae4-2305-4e7e-acdc-af98687c9e40 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:57.923032 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-59d85ae4-2305-4e7e-acdc-af98687c9e40 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:57.923032 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-59d85ae4-2305-4e7e-acdc-af98687c9e40 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:57.923032 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-59d85ae4-2305-4e7e-acdc-af98687c9e40 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:57.923032 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-59d85ae4-2305-4e7e-acdc-af98687c9e40 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:57.923569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-59d85ae4-2305-4e7e-acdc-af98687c9e40 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:58.153580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-59d85ae4-2305-4e7e-acdc-af98687c9e40 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:58.175911 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-59d85ae4-2305-4e7e-acdc-af98687c9e40 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:58.192730 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-59d85ae4-2305-4e7e-acdc-af98687c9e40 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:58.201928 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-59d85ae4-2305-4e7e-acdc-af98687c9e40 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1286 microversion: 2.20 time: 0.304294 Oct 04 08:51:58.204005 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 34/59] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:51:57 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1286 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:51:58.209445 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6219350c-3743-4976-8a71-c0184b92ff19 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:58.210279 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6219350c-3743-4976-8a71-c0184b92ff19 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:58.232247 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6219350c-3743-4976-8a71-c0184b92ff19 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:58.233162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6219350c-3743-4976-8a71-c0184b92ff19 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:58.233939 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6219350c-3743-4976-8a71-c0184b92ff19 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:58.236405 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6219350c-3743-4976-8a71-c0184b92ff19 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:58.237841 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6219350c-3743-4976-8a71-c0184b92ff19 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:58.238602 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6219350c-3743-4976-8a71-c0184b92ff19 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:58.453801 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-65123cd8-fc85-44ab-8738-374931ae25db tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:58.456595 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-65123cd8-fc85-44ab-8738-374931ae25db tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 1.126998 Oct 04 08:51:58.457209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 26/60] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:57 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:59.041369 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6219350c-3743-4976-8a71-c0184b92ff19 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:59.052393 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6219350c-3743-4976-8a71-c0184b92ff19 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.845728 Oct 04 08:51:59.052393 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 35/61] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:58 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:59.238605 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-24798dfa-9c2d-4e29-a319-89f4e2c487c4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:59.239526 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-24798dfa-9c2d-4e29-a319-89f4e2c487c4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:59.252298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-24798dfa-9c2d-4e29-a319-89f4e2c487c4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:59.264910 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-24798dfa-9c2d-4e29-a319-89f4e2c487c4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:59.267398 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-24798dfa-9c2d-4e29-a319-89f4e2c487c4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:59.268761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-24798dfa-9c2d-4e29-a319-89f4e2c487c4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:59.271184 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-24798dfa-9c2d-4e29-a319-89f4e2c487c4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:59.272203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-24798dfa-9c2d-4e29-a319-89f4e2c487c4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:59.487940 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-04497e7c-1a83-4785-8f0e-9970ab9f5250 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:59.489023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-04497e7c-1a83-4785-8f0e-9970ab9f5250 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:59.502919 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-04497e7c-1a83-4785-8f0e-9970ab9f5250 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:59.505152 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-04497e7c-1a83-4785-8f0e-9970ab9f5250 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:59.508106 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-04497e7c-1a83-4785-8f0e-9970ab9f5250 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:59.509861 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-04497e7c-1a83-4785-8f0e-9970ab9f5250 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:59.511010 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-04497e7c-1a83-4785-8f0e-9970ab9f5250 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:59.513637 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-04497e7c-1a83-4785-8f0e-9970ab9f5250 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:59.770510 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-24798dfa-9c2d-4e29-a319-89f4e2c487c4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:59.791328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-24798dfa-9c2d-4e29-a319-89f4e2c487c4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:59.806245 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-24798dfa-9c2d-4e29-a319-89f4e2c487c4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:59.811709 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-24798dfa-9c2d-4e29-a319-89f4e2c487c4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1334 microversion: 2.20 time: 0.574382 Oct 04 08:51:59.814729 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 27/62] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:51:59 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1334 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:51:59.921388 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-04497e7c-1a83-4785-8f0e-9970ab9f5250 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:59.933133 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-04497e7c-1a83-4785-8f0e-9970ab9f5250 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.450687 Oct 04 08:51:59.947911 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 36/63] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:59 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:00.082496 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-97b01abd-ee8e-4cf5-bb2e-1bcfb222951d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:00.083989 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-97b01abd-ee8e-4cf5-bb2e-1bcfb222951d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:00.128289 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-97b01abd-ee8e-4cf5-bb2e-1bcfb222951d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:00.130482 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-97b01abd-ee8e-4cf5-bb2e-1bcfb222951d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:00.134174 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-97b01abd-ee8e-4cf5-bb2e-1bcfb222951d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:00.149393 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-97b01abd-ee8e-4cf5-bb2e-1bcfb222951d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:00.151035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-97b01abd-ee8e-4cf5-bb2e-1bcfb222951d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:00.152352 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-97b01abd-ee8e-4cf5-bb2e-1bcfb222951d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:00.843115 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d5aff2fe-1286-4f88-be1d-e1294b3168ab tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:00.844505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d5aff2fe-1286-4f88-be1d-e1294b3168ab tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:00.846951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:00.848356 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=14 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:00.883421 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5aff2fe-1286-4f88-be1d-e1294b3168ab tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:00.886904 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5aff2fe-1286-4f88-be1d-e1294b3168ab tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:00.887365 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5aff2fe-1286-4f88-be1d-e1294b3168ab tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:00.890529 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5aff2fe-1286-4f88-be1d-e1294b3168ab tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:00.894142 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5aff2fe-1286-4f88-be1d-e1294b3168ab tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:00.901005 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5aff2fe-1286-4f88-be1d-e1294b3168ab tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:01.526810 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d5aff2fe-1286-4f88-be1d-e1294b3168ab tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:01.539501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d5aff2fe-1286-4f88-be1d-e1294b3168ab tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:01.554016 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-97b01abd-ee8e-4cf5-bb2e-1bcfb222951d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:01.562984 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-97b01abd-ee8e-4cf5-bb2e-1bcfb222951d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 1.487370 Oct 04 08:52:01.563830 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 28/64] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:00 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:01.568111 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d5aff2fe-1286-4f88-be1d-e1294b3168ab tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:01.569199 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d5aff2fe-1286-4f88-be1d-e1294b3168ab tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1340 microversion: 2.20 time: 0.731229 Oct 04 08:52:01.569744 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 37/65] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:00 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1340 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:01.574247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7328120f-e9c3-4261-9aae-a4df3ff1671d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:01.575107 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7328120f-e9c3-4261-9aae-a4df3ff1671d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:01.581637 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7328120f-e9c3-4261-9aae-a4df3ff1671d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:01.582380 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7328120f-e9c3-4261-9aae-a4df3ff1671d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:01.582995 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7328120f-e9c3-4261-9aae-a4df3ff1671d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:01.583872 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7328120f-e9c3-4261-9aae-a4df3ff1671d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:01.584529 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7328120f-e9c3-4261-9aae-a4df3ff1671d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:01.585132 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7328120f-e9c3-4261-9aae-a4df3ff1671d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:01.943078 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7328120f-e9c3-4261-9aae-a4df3ff1671d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:01.964923 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7328120f-e9c3-4261-9aae-a4df3ff1671d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.391736 Oct 04 08:52:01.970446 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 29/66] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:01 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:02.144334 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-e73fb020-088b-47e2-9ed0-1c9d1259d042 req-8beff36e-3798-4cab-8606-4139daa75836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28f0369-796d-4b75-b047-ccf9a6998560", "tag": "5dfb7890-2a06-487d-91f3-6ff8a9259582"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:02.182482 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-e73fb020-088b-47e2-9ed0-1c9d1259d042 req-8beff36e-3798-4cab-8606-4139daa75836 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:02.183335 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-e73fb020-088b-47e2-9ed0-1c9d1259d042 req-8beff36e-3798-4cab-8606-4139daa75836 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:02.184105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-e73fb020-088b-47e2-9ed0-1c9d1259d042 req-8beff36e-3798-4cab-8606-4139daa75836 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:02.236919 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-e73fb020-088b-47e2-9ed0-1c9d1259d042 req-8beff36e-3798-4cab-8606-4139daa75836 service nova] Creating event network-changed:5dfb7890-2a06-487d-91f3-6ff8a9259582 for instance d28f0369-796d-4b75-b047-ccf9a6998560 on hv-cinder-84456 Oct 04 08:52:02.237911 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-e73fb020-088b-47e2-9ed0-1c9d1259d042 req-8beff36e-3798-4cab-8606-4139daa75836 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=142439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 08:52:02.238301 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-e73fb020-088b-47e2-9ed0-1c9d1259d042 req-8beff36e-3798-4cab-8606-4139daa75836 service nova] Acquired lock "compute-rpcapi-router" {{(pid=142439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 08:52:02.239366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-082b8d39-5463-4aad-bd9a-2b5abf984f29 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:02.239818 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-082b8d39-5463-4aad-bd9a-2b5abf984f29 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:02.240267 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-082b8d39-5463-4aad-bd9a-2b5abf984f29 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:02.240968 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-082b8d39-5463-4aad-bd9a-2b5abf984f29 None None] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:02.241410 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-082b8d39-5463-4aad-bd9a-2b5abf984f29 None None] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:02.241821 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-082b8d39-5463-4aad-bd9a-2b5abf984f29 None None] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:02.251838 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-90a6fd33-6f89-4606-a04b-696c868a2804 req-200d7d70-f64d-4123-b9da-1941ac00c023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c263bad-2d03-4333-9fa9-89c8df65a642", "tag": "df362683-126c-4695-a04d-36d66437dfc5"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:02.294805 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-90a6fd33-6f89-4606-a04b-696c868a2804 req-200d7d70-f64d-4123-b9da-1941ac00c023 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:02.296397 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.compute.rpcapi [None req-082b8d39-5463-4aad-bd9a-2b5abf984f29 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 08:52:02.297035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-90a6fd33-6f89-4606-a04b-696c868a2804 req-200d7d70-f64d-4123-b9da-1941ac00c023 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:02.299069 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-90a6fd33-6f89-4606-a04b-696c868a2804 req-200d7d70-f64d-4123-b9da-1941ac00c023 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:02.300112 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-082b8d39-5463-4aad-bd9a-2b5abf984f29 None None] Releasing lock "compute-rpcapi-router" {{(pid=142439) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 08:52:02.357809 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-082b8d39-5463-4aad-bd9a-2b5abf984f29 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.408437 Oct 04 08:52:02.358992 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 38/67] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:02.363378 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-90a6fd33-6f89-4606-a04b-696c868a2804 req-200d7d70-f64d-4123-b9da-1941ac00c023 service nova] Creating event network-changed:df362683-126c-4695-a04d-36d66437dfc5 for instance 8c263bad-2d03-4333-9fa9-89c8df65a642 on hv-cinder-84456 Oct 04 08:52:02.364174 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-90a6fd33-6f89-4606-a04b-696c868a2804 req-200d7d70-f64d-4123-b9da-1941ac00c023 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=142438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 08:52:02.364727 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-90a6fd33-6f89-4606-a04b-696c868a2804 req-200d7d70-f64d-4123-b9da-1941ac00c023 service nova] Acquired lock "compute-rpcapi-router" {{(pid=142438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 08:52:02.368918 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10dc8787-8895-4f0b-b40f-dd7783aa9e41 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:02.371115 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10dc8787-8895-4f0b-b40f-dd7783aa9e41 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:02.372869 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10dc8787-8895-4f0b-b40f-dd7783aa9e41 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:02.373922 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10dc8787-8895-4f0b-b40f-dd7783aa9e41 None None] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:02.375541 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10dc8787-8895-4f0b-b40f-dd7783aa9e41 None None] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:02.377947 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10dc8787-8895-4f0b-b40f-dd7783aa9e41 None None] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:02.396593 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.compute.rpcapi [None req-10dc8787-8895-4f0b-b40f-dd7783aa9e41 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 08:52:02.398643 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10dc8787-8895-4f0b-b40f-dd7783aa9e41 None None] Releasing lock "compute-rpcapi-router" {{(pid=142438) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 08:52:02.432049 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-10dc8787-8895-4f0b-b40f-dd7783aa9e41 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.326568 Oct 04 08:52:02.433283 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 30/68] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:52:02.588548 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6e03df41-b079-439d-9f0b-13e8af1fc758 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:02.589474 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6e03df41-b079-439d-9f0b-13e8af1fc758 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:02.601424 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6e03df41-b079-439d-9f0b-13e8af1fc758 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:02.603448 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6e03df41-b079-439d-9f0b-13e8af1fc758 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:02.603668 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e612fec1-99b7-4e5c-8c64-e03ce42359f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:02.604931 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e612fec1-99b7-4e5c-8c64-e03ce42359f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:02.605197 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6e03df41-b079-439d-9f0b-13e8af1fc758 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:02.606031 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6e03df41-b079-439d-9f0b-13e8af1fc758 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:02.607757 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6e03df41-b079-439d-9f0b-13e8af1fc758 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:02.610673 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6e03df41-b079-439d-9f0b-13e8af1fc758 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:02.618976 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e612fec1-99b7-4e5c-8c64-e03ce42359f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:02.620094 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e612fec1-99b7-4e5c-8c64-e03ce42359f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:02.620527 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e612fec1-99b7-4e5c-8c64-e03ce42359f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:02.622266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e612fec1-99b7-4e5c-8c64-e03ce42359f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:02.627402 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e612fec1-99b7-4e5c-8c64-e03ce42359f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:02.628094 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e612fec1-99b7-4e5c-8c64-e03ce42359f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:02.959212 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e612fec1-99b7-4e5c-8c64-e03ce42359f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:02.977173 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e612fec1-99b7-4e5c-8c64-e03ce42359f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:02.979076 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e612fec1-99b7-4e5c-8c64-e03ce42359f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:02.981714 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e612fec1-99b7-4e5c-8c64-e03ce42359f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1340 microversion: 2.20 time: 0.382473 Oct 04 08:52:03.006865 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 31/69] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:02 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1340 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:03.018145 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-faf287b7-e66d-4617-bf9a-254ca53cd6e2 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:03.019039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-faf287b7-e66d-4617-bf9a-254ca53cd6e2 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:03.038186 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faf287b7-e66d-4617-bf9a-254ca53cd6e2 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:03.038777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faf287b7-e66d-4617-bf9a-254ca53cd6e2 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:03.039290 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faf287b7-e66d-4617-bf9a-254ca53cd6e2 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:03.042418 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faf287b7-e66d-4617-bf9a-254ca53cd6e2 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:03.042883 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faf287b7-e66d-4617-bf9a-254ca53cd6e2 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:03.043308 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faf287b7-e66d-4617-bf9a-254ca53cd6e2 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:03.437207 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6e03df41-b079-439d-9f0b-13e8af1fc758 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:03.457354 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6e03df41-b079-439d-9f0b-13e8af1fc758 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.874765 Oct 04 08:52:03.472938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 39/70] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:02 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:03.479521 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-cd436a05-ec66-404c-9909-2dbde51c1590 tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] Calling method '.version_select at 0x7ff92e6de8b0>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:03.563280 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-cd436a05-ec66-404c-9909-2dbde51c1590 tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/f8f4f104-3b86-4ae7-8a91-ec8af47e33e6" status: 200 len: 350 microversion: 2.1 time: 0.088878 Oct 04 08:52:03.564197 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 40/71] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:52:03 2022] GET /compute/v2.1/os-volumes/f8f4f104-3b86-4ae7-8a91-ec8af47e33e6 => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:03.665576 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-faf287b7-e66d-4617-bf9a-254ca53cd6e2 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:03.682414 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-faf287b7-e66d-4617-bf9a-254ca53cd6e2 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.674261 Oct 04 08:52:03.687078 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 32/72] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:03 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:04.013508 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-da763ec3-18a9-40a7-8b40-a4a2ffed5b98 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:04.015331 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-da763ec3-18a9-40a7-8b40-a4a2ffed5b98 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:04.024853 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-da763ec3-18a9-40a7-8b40-a4a2ffed5b98 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:04.027553 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-da763ec3-18a9-40a7-8b40-a4a2ffed5b98 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:04.031149 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-da763ec3-18a9-40a7-8b40-a4a2ffed5b98 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:04.034955 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-da763ec3-18a9-40a7-8b40-a4a2ffed5b98 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:04.036413 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-da763ec3-18a9-40a7-8b40-a4a2ffed5b98 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:04.037214 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-da763ec3-18a9-40a7-8b40-a4a2ffed5b98 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:04.428757 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-da763ec3-18a9-40a7-8b40-a4a2ffed5b98 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:04.440974 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-da763ec3-18a9-40a7-8b40-a4a2ffed5b98 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:04.443854 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-da763ec3-18a9-40a7-8b40-a4a2ffed5b98 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:04.445710 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-da763ec3-18a9-40a7-8b40-a4a2ffed5b98 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.436726 Oct 04 08:52:04.447102 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 41/73] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:04 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:04.456906 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-f52d37bf-b5b8-4ec5-b5f4-7765c1e0c3f7 req-ba9caebd-cd0c-4451-93a0-550844739efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e21016-5037-4bd1-91c6-97ab1b413e06", "tag": "df43f084-777f-4af6-b2a6-2d0d23572e5e"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:04.467696 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-f52d37bf-b5b8-4ec5-b5f4-7765c1e0c3f7 req-ba9caebd-cd0c-4451-93a0-550844739efc service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:04.468203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-f52d37bf-b5b8-4ec5-b5f4-7765c1e0c3f7 req-ba9caebd-cd0c-4451-93a0-550844739efc service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:04.468622 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-f52d37bf-b5b8-4ec5-b5f4-7765c1e0c3f7 req-ba9caebd-cd0c-4451-93a0-550844739efc service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:04.481906 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-f52d37bf-b5b8-4ec5-b5f4-7765c1e0c3f7 req-ba9caebd-cd0c-4451-93a0-550844739efc service nova] Creating event network-changed:df43f084-777f-4af6-b2a6-2d0d23572e5e for instance 69e21016-5037-4bd1-91c6-97ab1b413e06 on hv-cinder-84456 Oct 04 08:52:04.487832 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ad7f1fff-1ddd-4a89-8daf-396dd0e1c935 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:04.488936 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ad7f1fff-1ddd-4a89-8daf-396dd0e1c935 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:04.490026 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-f52d37bf-b5b8-4ec5-b5f4-7765c1e0c3f7 req-ba9caebd-cd0c-4451-93a0-550844739efc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037027 Oct 04 08:52:04.491285 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 33/74] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:04.497400 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ad7f1fff-1ddd-4a89-8daf-396dd0e1c935 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:04.498072 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ad7f1fff-1ddd-4a89-8daf-396dd0e1c935 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:04.498511 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ad7f1fff-1ddd-4a89-8daf-396dd0e1c935 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:04.499219 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ad7f1fff-1ddd-4a89-8daf-396dd0e1c935 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:04.499674 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ad7f1fff-1ddd-4a89-8daf-396dd0e1c935 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:04.500237 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ad7f1fff-1ddd-4a89-8daf-396dd0e1c935 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:04.707709 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ad7f1fff-1ddd-4a89-8daf-396dd0e1c935 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:04.712437 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f1de9574-d0c6-4259-9df8-dc5382174aba tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:04.714607 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f1de9574-d0c6-4259-9df8-dc5382174aba tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:04.715950 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ad7f1fff-1ddd-4a89-8daf-396dd0e1c935 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.233929 Oct 04 08:52:04.725282 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f1de9574-d0c6-4259-9df8-dc5382174aba tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:04.726089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f1de9574-d0c6-4259-9df8-dc5382174aba tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:04.726872 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f1de9574-d0c6-4259-9df8-dc5382174aba tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:04.727293 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 42/75] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:04 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:04.728135 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f1de9574-d0c6-4259-9df8-dc5382174aba tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:04.728789 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f1de9574-d0c6-4259-9df8-dc5382174aba tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:04.729528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f1de9574-d0c6-4259-9df8-dc5382174aba tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:04.887170 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f1de9574-d0c6-4259-9df8-dc5382174aba tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:04.898595 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f1de9574-d0c6-4259-9df8-dc5382174aba tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.190444 Oct 04 08:52:04.899272 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 34/76] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:04 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:05.479481 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-78980f16-70ba-4bd1-ba0a-6bebb32feb15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:05.480651 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-78980f16-70ba-4bd1-ba0a-6bebb32feb15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:05.487649 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-78980f16-70ba-4bd1-ba0a-6bebb32feb15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:05.488530 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-78980f16-70ba-4bd1-ba0a-6bebb32feb15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:05.489447 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-78980f16-70ba-4bd1-ba0a-6bebb32feb15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:05.490132 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-78980f16-70ba-4bd1-ba0a-6bebb32feb15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:05.490574 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-78980f16-70ba-4bd1-ba0a-6bebb32feb15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:05.491263 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-78980f16-70ba-4bd1-ba0a-6bebb32feb15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:05.639503 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-78980f16-70ba-4bd1-ba0a-6bebb32feb15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:05.649496 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-78980f16-70ba-4bd1-ba0a-6bebb32feb15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:05.650869 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-78980f16-70ba-4bd1-ba0a-6bebb32feb15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:05.652012 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-78980f16-70ba-4bd1-ba0a-6bebb32feb15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.177325 Oct 04 08:52:05.653025 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 43/77] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:05 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:05.744736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c45e3576-7c73-42f2-bbd0-b87fa44e8d55 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:05.746403 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c45e3576-7c73-42f2-bbd0-b87fa44e8d55 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:05.761902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c45e3576-7c73-42f2-bbd0-b87fa44e8d55 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:05.761902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c45e3576-7c73-42f2-bbd0-b87fa44e8d55 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:05.761902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c45e3576-7c73-42f2-bbd0-b87fa44e8d55 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:05.762278 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c45e3576-7c73-42f2-bbd0-b87fa44e8d55 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:05.762726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c45e3576-7c73-42f2-bbd0-b87fa44e8d55 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:05.763148 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c45e3576-7c73-42f2-bbd0-b87fa44e8d55 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:05.907466 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c45e3576-7c73-42f2-bbd0-b87fa44e8d55 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:05.922219 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-18cb6f74-4d0f-497f-bbbd-3c6f32ac8449 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:05.922831 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-18cb6f74-4d0f-497f-bbbd-3c6f32ac8449 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:05.927783 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c45e3576-7c73-42f2-bbd0-b87fa44e8d55 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.187658 Oct 04 08:52:05.928408 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 35/78] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:05 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:05.954249 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-18cb6f74-4d0f-497f-bbbd-3c6f32ac8449 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:05.954735 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-18cb6f74-4d0f-497f-bbbd-3c6f32ac8449 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:05.955339 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-18cb6f74-4d0f-497f-bbbd-3c6f32ac8449 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:05.956067 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-18cb6f74-4d0f-497f-bbbd-3c6f32ac8449 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:05.956520 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-18cb6f74-4d0f-497f-bbbd-3c6f32ac8449 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:05.956937 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-18cb6f74-4d0f-497f-bbbd-3c6f32ac8449 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:05.981845 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=100 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:06.108403 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-18cb6f74-4d0f-497f-bbbd-3c6f32ac8449 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:06.119556 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-18cb6f74-4d0f-497f-bbbd-3c6f32ac8449 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.201653 Oct 04 08:52:06.120479 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 44/79] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:05 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:06.678376 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6dc0ab48-c262-4fd4-a654-3c5e781ba05a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:06.678914 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6dc0ab48-c262-4fd4-a654-3c5e781ba05a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:06.684956 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6dc0ab48-c262-4fd4-a654-3c5e781ba05a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:06.685436 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6dc0ab48-c262-4fd4-a654-3c5e781ba05a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:06.685867 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6dc0ab48-c262-4fd4-a654-3c5e781ba05a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:06.686549 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6dc0ab48-c262-4fd4-a654-3c5e781ba05a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:06.687000 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6dc0ab48-c262-4fd4-a654-3c5e781ba05a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:06.687416 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6dc0ab48-c262-4fd4-a654-3c5e781ba05a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:06.813460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6dc0ab48-c262-4fd4-a654-3c5e781ba05a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:06.822046 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6dc0ab48-c262-4fd4-a654-3c5e781ba05a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:06.823747 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6dc0ab48-c262-4fd4-a654-3c5e781ba05a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:06.824913 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6dc0ab48-c262-4fd4-a654-3c5e781ba05a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.150691 Oct 04 08:52:06.825840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 36/80] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:06 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:06.954915 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b7d8e6f1-6153-4461-b5aa-2e6e7e8a71e0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:06.955975 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b7d8e6f1-6153-4461-b5aa-2e6e7e8a71e0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:06.964442 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b7d8e6f1-6153-4461-b5aa-2e6e7e8a71e0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:06.964939 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b7d8e6f1-6153-4461-b5aa-2e6e7e8a71e0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:06.965405 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b7d8e6f1-6153-4461-b5aa-2e6e7e8a71e0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:06.966111 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b7d8e6f1-6153-4461-b5aa-2e6e7e8a71e0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:06.966567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b7d8e6f1-6153-4461-b5aa-2e6e7e8a71e0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:06.966991 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b7d8e6f1-6153-4461-b5aa-2e6e7e8a71e0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:07.098190 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b7d8e6f1-6153-4461-b5aa-2e6e7e8a71e0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:07.106235 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b7d8e6f1-6153-4461-b5aa-2e6e7e8a71e0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.157997 Oct 04 08:52:07.106788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 45/81] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:06 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:07.145222 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-937e81f8-b799-4f1c-8a85-acd6d4b40e3d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:07.145834 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-937e81f8-b799-4f1c-8a85-acd6d4b40e3d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:07.147903 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=24 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:07.154142 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-937e81f8-b799-4f1c-8a85-acd6d4b40e3d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:07.154621 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-937e81f8-b799-4f1c-8a85-acd6d4b40e3d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:07.155047 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-937e81f8-b799-4f1c-8a85-acd6d4b40e3d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:07.155731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-937e81f8-b799-4f1c-8a85-acd6d4b40e3d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:07.156211 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-937e81f8-b799-4f1c-8a85-acd6d4b40e3d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:07.156629 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-937e81f8-b799-4f1c-8a85-acd6d4b40e3d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:07.293042 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-937e81f8-b799-4f1c-8a85-acd6d4b40e3d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:07.300940 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-937e81f8-b799-4f1c-8a85-acd6d4b40e3d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.159492 Oct 04 08:52:07.301574 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 37/82] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:07 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:07.851396 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d5df5fbe-b82d-4729-a5b3-fa57f283c442 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:07.852088 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d5df5fbe-b82d-4729-a5b3-fa57f283c442 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:07.858834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5df5fbe-b82d-4729-a5b3-fa57f283c442 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:07.859372 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5df5fbe-b82d-4729-a5b3-fa57f283c442 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:07.859851 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5df5fbe-b82d-4729-a5b3-fa57f283c442 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:07.860657 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5df5fbe-b82d-4729-a5b3-fa57f283c442 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:07.861151 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5df5fbe-b82d-4729-a5b3-fa57f283c442 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:07.861701 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5df5fbe-b82d-4729-a5b3-fa57f283c442 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:07.998823 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d5df5fbe-b82d-4729-a5b3-fa57f283c442 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:08.007023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d5df5fbe-b82d-4729-a5b3-fa57f283c442 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:08.008557 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d5df5fbe-b82d-4729-a5b3-fa57f283c442 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:08.009658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d5df5fbe-b82d-4729-a5b3-fa57f283c442 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.162608 Oct 04 08:52:08.010220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 46/83] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:07 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:08.134244 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-848d6e1e-65c7-4e42-94c6-b496dbee3505 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:08.135178 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-848d6e1e-65c7-4e42-94c6-b496dbee3505 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:08.145171 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-848d6e1e-65c7-4e42-94c6-b496dbee3505 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:08.145958 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-848d6e1e-65c7-4e42-94c6-b496dbee3505 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:08.146669 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-848d6e1e-65c7-4e42-94c6-b496dbee3505 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:08.148514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-848d6e1e-65c7-4e42-94c6-b496dbee3505 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:08.149184 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-848d6e1e-65c7-4e42-94c6-b496dbee3505 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:08.149795 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-848d6e1e-65c7-4e42-94c6-b496dbee3505 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:08.302649 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-848d6e1e-65c7-4e42-94c6-b496dbee3505 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:08.310636 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-848d6e1e-65c7-4e42-94c6-b496dbee3505 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.183506 Oct 04 08:52:08.311869 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 38/84] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:08 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:08.329461 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2cbfec55-aa30-45d0-9df2-125dcb26cea0 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:08.330083 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2cbfec55-aa30-45d0-9df2-125dcb26cea0 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:08.336223 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2cbfec55-aa30-45d0-9df2-125dcb26cea0 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:08.336708 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2cbfec55-aa30-45d0-9df2-125dcb26cea0 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:08.337141 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2cbfec55-aa30-45d0-9df2-125dcb26cea0 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:08.337832 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2cbfec55-aa30-45d0-9df2-125dcb26cea0 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:08.338281 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2cbfec55-aa30-45d0-9df2-125dcb26cea0 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:08.338697 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2cbfec55-aa30-45d0-9df2-125dcb26cea0 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:08.473496 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2cbfec55-aa30-45d0-9df2-125dcb26cea0 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:08.481472 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2cbfec55-aa30-45d0-9df2-125dcb26cea0 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.162748 Oct 04 08:52:08.482232 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 47/85] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:08 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:09.038873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-59ac7194-bb01-41d0-b3fd-ae3ed2822b73 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:09.039490 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-59ac7194-bb01-41d0-b3fd-ae3ed2822b73 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:09.046218 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-59ac7194-bb01-41d0-b3fd-ae3ed2822b73 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:09.046926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-59ac7194-bb01-41d0-b3fd-ae3ed2822b73 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:09.047564 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-59ac7194-bb01-41d0-b3fd-ae3ed2822b73 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:09.048468 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-59ac7194-bb01-41d0-b3fd-ae3ed2822b73 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:09.049096 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-59ac7194-bb01-41d0-b3fd-ae3ed2822b73 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:09.049690 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-59ac7194-bb01-41d0-b3fd-ae3ed2822b73 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:09.198236 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-59ac7194-bb01-41d0-b3fd-ae3ed2822b73 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:09.208925 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-59ac7194-bb01-41d0-b3fd-ae3ed2822b73 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:09.210365 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-59ac7194-bb01-41d0-b3fd-ae3ed2822b73 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:09.211611 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-59ac7194-bb01-41d0-b3fd-ae3ed2822b73 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.181129 Oct 04 08:52:09.212191 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 39/86] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:09 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:09.334552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d241871c-70ad-42bd-aa49-aa3b6b9b25b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:09.335150 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d241871c-70ad-42bd-aa49-aa3b6b9b25b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:09.341246 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d241871c-70ad-42bd-aa49-aa3b6b9b25b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:09.344535 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d241871c-70ad-42bd-aa49-aa3b6b9b25b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:09.345047 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d241871c-70ad-42bd-aa49-aa3b6b9b25b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:09.345959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d241871c-70ad-42bd-aa49-aa3b6b9b25b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:09.346600 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d241871c-70ad-42bd-aa49-aa3b6b9b25b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:09.347221 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d241871c-70ad-42bd-aa49-aa3b6b9b25b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:09.493145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d241871c-70ad-42bd-aa49-aa3b6b9b25b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:09.501808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d241871c-70ad-42bd-aa49-aa3b6b9b25b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.171001 Oct 04 08:52:09.502412 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 48/87] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:09 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:09.505160 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4021f11e-6d3e-464e-aa0a-73618f7348b7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:09.505845 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4021f11e-6d3e-464e-aa0a-73618f7348b7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:09.513092 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4021f11e-6d3e-464e-aa0a-73618f7348b7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:09.513661 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4021f11e-6d3e-464e-aa0a-73618f7348b7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:09.514157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4021f11e-6d3e-464e-aa0a-73618f7348b7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:09.515094 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4021f11e-6d3e-464e-aa0a-73618f7348b7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:09.515727 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4021f11e-6d3e-464e-aa0a-73618f7348b7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:09.516555 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4021f11e-6d3e-464e-aa0a-73618f7348b7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:09.538670 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=100 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:09.674761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4021f11e-6d3e-464e-aa0a-73618f7348b7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:09.685556 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4021f11e-6d3e-464e-aa0a-73618f7348b7 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.184341 Oct 04 08:52:09.686967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 40/88] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:09 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:10.239853 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1608dac1-042c-4186-8482-9cb30751f6fb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:10.240929 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1608dac1-042c-4186-8482-9cb30751f6fb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:10.249798 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1608dac1-042c-4186-8482-9cb30751f6fb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:10.250282 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1608dac1-042c-4186-8482-9cb30751f6fb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:10.250710 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1608dac1-042c-4186-8482-9cb30751f6fb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:10.251395 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1608dac1-042c-4186-8482-9cb30751f6fb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:10.251865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1608dac1-042c-4186-8482-9cb30751f6fb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:10.252317 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1608dac1-042c-4186-8482-9cb30751f6fb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:10.524876 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5759245d-8982-4200-bd78-9c9f56c78688 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:10.526215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5759245d-8982-4200-bd78-9c9f56c78688 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:10.532270 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5759245d-8982-4200-bd78-9c9f56c78688 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:10.532751 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5759245d-8982-4200-bd78-9c9f56c78688 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:10.533173 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5759245d-8982-4200-bd78-9c9f56c78688 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:10.533888 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5759245d-8982-4200-bd78-9c9f56c78688 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:10.534329 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5759245d-8982-4200-bd78-9c9f56c78688 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:10.534741 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5759245d-8982-4200-bd78-9c9f56c78688 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:10.539108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1608dac1-042c-4186-8482-9cb30751f6fb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:10.547753 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1608dac1-042c-4186-8482-9cb30751f6fb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:10.549247 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1608dac1-042c-4186-8482-9cb30751f6fb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:10.550363 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1608dac1-042c-4186-8482-9cb30751f6fb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.316290 Oct 04 08:52:10.551104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 49/89] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:10 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:10.711434 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-33bb1dc6-7902-4f57-9289-8223dd136011 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:10.714896 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-33bb1dc6-7902-4f57-9289-8223dd136011 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:10.733325 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-33bb1dc6-7902-4f57-9289-8223dd136011 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:10.734063 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-33bb1dc6-7902-4f57-9289-8223dd136011 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:10.734397 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-33bb1dc6-7902-4f57-9289-8223dd136011 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:10.735105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-33bb1dc6-7902-4f57-9289-8223dd136011 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:10.735551 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-33bb1dc6-7902-4f57-9289-8223dd136011 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:10.736158 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-33bb1dc6-7902-4f57-9289-8223dd136011 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:10.808797 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5759245d-8982-4200-bd78-9c9f56c78688 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:10.818341 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5759245d-8982-4200-bd78-9c9f56c78688 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.297473 Oct 04 08:52:10.838761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 41/90] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:10 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:10.848435 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ffd77afc-df6e-4bcb-999c-9eeee99fc0bf tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] Calling method '.version_select at 0x7ff92e71e9d0>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:10.922624 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ffd77afc-df6e-4bcb-999c-9eeee99fc0bf tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e4a70b5a-87d1-4724-b9e5-93af2d17824f" status: 200 len: 350 microversion: 2.1 time: 0.080504 Oct 04 08:52:10.923314 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 42/91] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:52:10 2022] GET /compute/v2.1/os-volumes/e4a70b5a-87d1-4724-b9e5-93af2d17824f => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:10.942472 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-33bb1dc6-7902-4f57-9289-8223dd136011 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:10.958972 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-33bb1dc6-7902-4f57-9289-8223dd136011 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.253209 Oct 04 08:52:10.985466 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 50/92] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:10 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:11.576472 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-61fb0a69-ad2e-43f8-9d0d-4a05bdbeac5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:11.577153 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-61fb0a69-ad2e-43f8-9d0d-4a05bdbeac5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:11.580243 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:11.583923 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-61fb0a69-ad2e-43f8-9d0d-4a05bdbeac5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:11.584395 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-61fb0a69-ad2e-43f8-9d0d-4a05bdbeac5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:11.584825 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-61fb0a69-ad2e-43f8-9d0d-4a05bdbeac5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:11.585513 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-61fb0a69-ad2e-43f8-9d0d-4a05bdbeac5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:11.586080 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-61fb0a69-ad2e-43f8-9d0d-4a05bdbeac5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:11.586520 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-61fb0a69-ad2e-43f8-9d0d-4a05bdbeac5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:11.723571 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-578e92d5-b8fe-464f-af1a-141d5326218a req-ee7e7ad1-52fc-4452-8ff7-f9146c9ee517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4454abc-67a9-470b-bdce-5a69bc51bbed", "tag": "a52bd48f-906c-4b87-b387-01e1bfaa69c2"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:11.724110 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-61fb0a69-ad2e-43f8-9d0d-4a05bdbeac5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:11.729982 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:11.733907 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-61fb0a69-ad2e-43f8-9d0d-4a05bdbeac5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:11.734073 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-578e92d5-b8fe-464f-af1a-141d5326218a req-ee7e7ad1-52fc-4452-8ff7-f9146c9ee517 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:11.734607 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-578e92d5-b8fe-464f-af1a-141d5326218a req-ee7e7ad1-52fc-4452-8ff7-f9146c9ee517 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:11.735247 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-578e92d5-b8fe-464f-af1a-141d5326218a req-ee7e7ad1-52fc-4452-8ff7-f9146c9ee517 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:11.735651 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-61fb0a69-ad2e-43f8-9d0d-4a05bdbeac5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:11.736864 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-61fb0a69-ad2e-43f8-9d0d-4a05bdbeac5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.164655 Oct 04 08:52:11.737933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 43/93] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:11 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:11.752131 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-578e92d5-b8fe-464f-af1a-141d5326218a req-ee7e7ad1-52fc-4452-8ff7-f9146c9ee517 service nova] Creating event network-changed:a52bd48f-906c-4b87-b387-01e1bfaa69c2 for instance f4454abc-67a9-470b-bdce-5a69bc51bbed on hv-cinder-84456 Oct 04 08:52:11.753225 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-578e92d5-b8fe-464f-af1a-141d5326218a req-ee7e7ad1-52fc-4452-8ff7-f9146c9ee517 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033556 Oct 04 08:52:11.753919 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 51/94] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:52:11.843185 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-54fe42c0-a023-4505-9cba-19e148ee08c1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:11.843864 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-54fe42c0-a023-4505-9cba-19e148ee08c1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:11.850186 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-54fe42c0-a023-4505-9cba-19e148ee08c1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:11.850753 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-54fe42c0-a023-4505-9cba-19e148ee08c1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:11.851211 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-54fe42c0-a023-4505-9cba-19e148ee08c1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:11.851977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-54fe42c0-a023-4505-9cba-19e148ee08c1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:11.852470 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-54fe42c0-a023-4505-9cba-19e148ee08c1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:11.852891 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-54fe42c0-a023-4505-9cba-19e148ee08c1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:11.990931 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-54fe42c0-a023-4505-9cba-19e148ee08c1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:11.999110 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-54fe42c0-a023-4505-9cba-19e148ee08c1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.161332 Oct 04 08:52:11.999682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 44/95] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:11 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:12.003741 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c645e7b2-09cf-4f97-beb6-b33eaecfea33 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:12.004469 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c645e7b2-09cf-4f97-beb6-b33eaecfea33 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:12.010825 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c645e7b2-09cf-4f97-beb6-b33eaecfea33 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:12.011300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c645e7b2-09cf-4f97-beb6-b33eaecfea33 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:12.011729 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c645e7b2-09cf-4f97-beb6-b33eaecfea33 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:12.012437 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c645e7b2-09cf-4f97-beb6-b33eaecfea33 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:12.012884 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c645e7b2-09cf-4f97-beb6-b33eaecfea33 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:12.013333 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c645e7b2-09cf-4f97-beb6-b33eaecfea33 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:12.150778 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c645e7b2-09cf-4f97-beb6-b33eaecfea33 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:12.158987 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c645e7b2-09cf-4f97-beb6-b33eaecfea33 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.159282 Oct 04 08:52:12.159568 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 52/96] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:11 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:12.523220 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-66acd084-d551-4dfe-a59b-326fbb5e6149 tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] Calling method '.version_select at 0x7ff92e7311f0>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:12.531266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=8 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:12.585826 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-66acd084-d551-4dfe-a59b-326fbb5e6149 tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/8376bd51-a9db-4c03-b1df-8dc511a5dfa5" status: 200 len: 351 microversion: 2.1 time: 0.066194 Oct 04 08:52:12.586780 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 45/97] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Oct 4 08:52:12 2022] GET /compute/v2.1/os-volumes/8376bd51-a9db-4c03-b1df-8dc511a5dfa5 => generated 351 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:12.600319 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-11d1f27e-a872-4ce0-b946-7283a9f3209c tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] Calling method '.version_select at 0x7ff92e6f8790>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:12.610465 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:12.700839 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-11d1f27e-a872-4ce0-b946-7283a9f3209c tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.104284 Oct 04 08:52:12.701357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 53/98] 10.222.0.44 () {58 vars in 1134 bytes} [Tue Oct 4 08:52:12 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:12.716170 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-3c5d2b01-d77e-4536-b64a-f56b3d21a2f2 tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] Calling method '.version_select at 0x7ff92e731e50>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:12.763730 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-12e3b746-4672-4814-b9a9-4bc4039c1f2d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:12.764449 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-12e3b746-4672-4814-b9a9-4bc4039c1f2d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:12.774398 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12e3b746-4672-4814-b9a9-4bc4039c1f2d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:12.775266 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12e3b746-4672-4814-b9a9-4bc4039c1f2d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:12.775697 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12e3b746-4672-4814-b9a9-4bc4039c1f2d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:12.776753 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12e3b746-4672-4814-b9a9-4bc4039c1f2d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:12.777595 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12e3b746-4672-4814-b9a9-4bc4039c1f2d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:12.778028 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12e3b746-4672-4814-b9a9-4bc4039c1f2d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:12.806504 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-3c5d2b01-d77e-4536-b64a-f56b3d21a2f2 tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094004 Oct 04 08:52:12.807254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 46/99] 10.222.0.44 () {58 vars in 1149 bytes} [Tue Oct 4 08:52:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:12.821482 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e1dc608d-b9be-4b1c-bb8f-d0075e66d97f tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] Calling method '.version_select at 0x7ff92e71e9d0>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:12.928416 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e1dc608d-b9be-4b1c-bb8f-d0075e66d97f tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.110822 Oct 04 08:52:12.929594 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 47/100] 10.222.0.44 () {58 vars in 1134 bytes} [Tue Oct 4 08:52:12 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:12.942839 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e758f6db-b01a-416c-87ae-76968d2eb015 tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] Calling method '.version_select at 0x7ff92e749820>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:12.950831 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-12e3b746-4672-4814-b9a9-4bc4039c1f2d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:12.975763 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-12e3b746-4672-4814-b9a9-4bc4039c1f2d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:12.978020 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-12e3b746-4672-4814-b9a9-4bc4039c1f2d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:12.979163 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-12e3b746-4672-4814-b9a9-4bc4039c1f2d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.219834 Oct 04 08:52:12.979737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 54/101] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:12 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:52:13.023427 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ada47dc0-1a21-41dc-93d0-6e412bbeed0e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:13.024461 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ada47dc0-1a21-41dc-93d0-6e412bbeed0e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:13.030686 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ada47dc0-1a21-41dc-93d0-6e412bbeed0e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:13.031932 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ada47dc0-1a21-41dc-93d0-6e412bbeed0e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:13.032873 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ada47dc0-1a21-41dc-93d0-6e412bbeed0e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:13.033778 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ada47dc0-1a21-41dc-93d0-6e412bbeed0e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:13.034375 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ada47dc0-1a21-41dc-93d0-6e412bbeed0e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:13.034792 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ada47dc0-1a21-41dc-93d0-6e412bbeed0e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:13.039336 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e758f6db-b01a-416c-87ae-76968d2eb015 tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.100016 Oct 04 08:52:13.039811 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 48/102] 10.222.0.44 () {58 vars in 1167 bytes} [Tue Oct 4 08:52:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:52:13.056563 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0296bd10-9992-4ac2-9680-a85a0eeda736 tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] Calling method '.version_select at 0x7ff92e731d30>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:13.151700 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0296bd10-9992-4ac2-9680-a85a0eeda736 tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.099184 Oct 04 08:52:13.153178 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 49/103] 10.222.0.44 () {58 vars in 1170 bytes} [Tue Oct 4 08:52:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:52:13.166712 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a1cd78b1-98c2-4652-a25c-224238428de7 tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] Calling method '.version_select at 0x7ff92e768940>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:13.173950 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ada47dc0-1a21-41dc-93d0-6e412bbeed0e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:13.182067 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ada47dc0-1a21-41dc-93d0-6e412bbeed0e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.163896 Oct 04 08:52:13.182640 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 55/104] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:13 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:13.196928 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9ecafd19-1a6d-41d8-8e05-74318aad8f71 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:13.197554 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9ecafd19-1a6d-41d8-8e05-74318aad8f71 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:13.204117 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ecafd19-1a6d-41d8-8e05-74318aad8f71 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:13.204691 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ecafd19-1a6d-41d8-8e05-74318aad8f71 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:13.205197 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ecafd19-1a6d-41d8-8e05-74318aad8f71 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:13.205878 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ecafd19-1a6d-41d8-8e05-74318aad8f71 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:13.206328 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ecafd19-1a6d-41d8-8e05-74318aad8f71 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:13.206780 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ecafd19-1a6d-41d8-8e05-74318aad8f71 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:13.266929 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a1cd78b1-98c2-4652-a25c-224238428de7 tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.103862 Oct 04 08:52:13.267701 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 50/105] 10.222.0.44 () {58 vars in 1155 bytes} [Tue Oct 4 08:52:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:13.281610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-fbebc50c-47e7-4a0d-b7c4-1fc7e1d3718d tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] Calling method '.version_select at 0x7ff92e6f9940>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:13.365693 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9ecafd19-1a6d-41d8-8e05-74318aad8f71 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:13.368928 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-fbebc50c-47e7-4a0d-b7c4-1fc7e1d3718d tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091031 Oct 04 08:52:13.369511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 51/106] 10.222.0.44 () {58 vars in 1188 bytes} [Tue Oct 4 08:52:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:13.376371 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9ecafd19-1a6d-41d8-8e05-74318aad8f71 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.183413 Oct 04 08:52:13.388971 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 56/107] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:13 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:13.389129 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-fab3620e-940e-428a-9055-80573ea7571e tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] Calling method '.version_select at 0x7ff92e7f10d0>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:13.493065 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-fab3620e-940e-428a-9055-80573ea7571e tempest-VolumesTestJSON-299105889 tempest-VolumesTestJSON-299105889-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.113870 Oct 04 08:52:13.493651 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 52/108] 10.222.0.44 () {58 vars in 1155 bytes} [Tue Oct 4 08:52:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:14.005829 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-da72026d-8d0d-4240-95e9-566736ed7288 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:14.006380 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-da72026d-8d0d-4240-95e9-566736ed7288 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:14.012950 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-da72026d-8d0d-4240-95e9-566736ed7288 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:14.013110 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-da72026d-8d0d-4240-95e9-566736ed7288 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:14.013595 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-da72026d-8d0d-4240-95e9-566736ed7288 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:14.014186 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-da72026d-8d0d-4240-95e9-566736ed7288 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:14.014804 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-da72026d-8d0d-4240-95e9-566736ed7288 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:14.015232 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-da72026d-8d0d-4240-95e9-566736ed7288 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:14.177518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-da72026d-8d0d-4240-95e9-566736ed7288 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:14.185778 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-da72026d-8d0d-4240-95e9-566736ed7288 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:14.187397 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-da72026d-8d0d-4240-95e9-566736ed7288 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:14.188529 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-da72026d-8d0d-4240-95e9-566736ed7288 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.186736 Oct 04 08:52:14.189298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 57/109] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:14 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:14.209294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-250d5b59-6a71-41a9-b96a-d1ae707ca886 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:14.210032 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-250d5b59-6a71-41a9-b96a-d1ae707ca886 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:14.217193 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-250d5b59-6a71-41a9-b96a-d1ae707ca886 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:14.217674 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-250d5b59-6a71-41a9-b96a-d1ae707ca886 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:14.218120 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-250d5b59-6a71-41a9-b96a-d1ae707ca886 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:14.218878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-250d5b59-6a71-41a9-b96a-d1ae707ca886 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:14.219325 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-250d5b59-6a71-41a9-b96a-d1ae707ca886 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:14.219743 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-250d5b59-6a71-41a9-b96a-d1ae707ca886 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:14.361165 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-250d5b59-6a71-41a9-b96a-d1ae707ca886 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:14.369094 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-250d5b59-6a71-41a9-b96a-d1ae707ca886 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.163948 Oct 04 08:52:14.369657 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 53/110] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:14 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:14.400554 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b5295422-9aca-46b2-b7b4-e418b3c9a64b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:14.401312 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b5295422-9aca-46b2-b7b4-e418b3c9a64b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:14.408552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5295422-9aca-46b2-b7b4-e418b3c9a64b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:14.409194 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5295422-9aca-46b2-b7b4-e418b3c9a64b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:14.409726 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5295422-9aca-46b2-b7b4-e418b3c9a64b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:14.410570 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5295422-9aca-46b2-b7b4-e418b3c9a64b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:14.411054 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5295422-9aca-46b2-b7b4-e418b3c9a64b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:14.411699 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5295422-9aca-46b2-b7b4-e418b3c9a64b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:14.545959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b5295422-9aca-46b2-b7b4-e418b3c9a64b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:14.554106 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b5295422-9aca-46b2-b7b4-e418b3c9a64b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.157773 Oct 04 08:52:14.554705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 58/111] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:14 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:15.213491 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1ff0cd9a-ae12-4bb5-912f-fe68b3010ed0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:15.214121 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1ff0cd9a-ae12-4bb5-912f-fe68b3010ed0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:15.224637 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ff0cd9a-ae12-4bb5-912f-fe68b3010ed0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:15.225483 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ff0cd9a-ae12-4bb5-912f-fe68b3010ed0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:15.227555 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ff0cd9a-ae12-4bb5-912f-fe68b3010ed0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:15.228356 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ff0cd9a-ae12-4bb5-912f-fe68b3010ed0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:15.228967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ff0cd9a-ae12-4bb5-912f-fe68b3010ed0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:15.229539 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ff0cd9a-ae12-4bb5-912f-fe68b3010ed0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:15.391560 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fc528519-c604-4f77-b3d6-f341086ebd95 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:15.393514 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-fc528519-c604-4f77-b3d6-f341086ebd95 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:15.400357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc528519-c604-4f77-b3d6-f341086ebd95 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:15.401002 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc528519-c604-4f77-b3d6-f341086ebd95 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:15.401589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc528519-c604-4f77-b3d6-f341086ebd95 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:15.402430 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc528519-c604-4f77-b3d6-f341086ebd95 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:15.403154 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc528519-c604-4f77-b3d6-f341086ebd95 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:15.403762 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc528519-c604-4f77-b3d6-f341086ebd95 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:15.404576 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1ff0cd9a-ae12-4bb5-912f-fe68b3010ed0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:15.416001 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1ff0cd9a-ae12-4bb5-912f-fe68b3010ed0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:15.417535 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1ff0cd9a-ae12-4bb5-912f-fe68b3010ed0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:15.418645 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1ff0cd9a-ae12-4bb5-912f-fe68b3010ed0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.209149 Oct 04 08:52:15.420098 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 54/112] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:15 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:15.556502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-fc528519-c604-4f77-b3d6-f341086ebd95 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:15.565576 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fc528519-c604-4f77-b3d6-f341086ebd95 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.177862 Oct 04 08:52:15.566146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 59/113] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:15 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:15.581947 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8bcca4ce-27fc-4c88-881f-5555278a116e tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:15.582848 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8bcca4ce-27fc-4c88-881f-5555278a116e tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:15.593357 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8bcca4ce-27fc-4c88-881f-5555278a116e tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:15.594441 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8bcca4ce-27fc-4c88-881f-5555278a116e tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:15.595250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8bcca4ce-27fc-4c88-881f-5555278a116e tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:15.596339 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8bcca4ce-27fc-4c88-881f-5555278a116e tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:15.596952 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8bcca4ce-27fc-4c88-881f-5555278a116e tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:15.597755 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8bcca4ce-27fc-4c88-881f-5555278a116e tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:15.758923 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8bcca4ce-27fc-4c88-881f-5555278a116e tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:15.771915 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8bcca4ce-27fc-4c88-881f-5555278a116e tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.197166 Oct 04 08:52:15.773150 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 55/114] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:15 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:16.447618 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d4e08444-7b51-4b38-b07c-82dac3ff8709 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:16.448414 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d4e08444-7b51-4b38-b07c-82dac3ff8709 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:16.456113 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d4e08444-7b51-4b38-b07c-82dac3ff8709 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:16.456683 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d4e08444-7b51-4b38-b07c-82dac3ff8709 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:16.457306 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d4e08444-7b51-4b38-b07c-82dac3ff8709 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:16.458072 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d4e08444-7b51-4b38-b07c-82dac3ff8709 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:16.458593 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d4e08444-7b51-4b38-b07c-82dac3ff8709 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:16.459074 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d4e08444-7b51-4b38-b07c-82dac3ff8709 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:16.589358 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f39fe7f5-d05d-4aa1-8300-816e7bbabf4c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:16.590183 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f39fe7f5-d05d-4aa1-8300-816e7bbabf4c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:16.597519 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f39fe7f5-d05d-4aa1-8300-816e7bbabf4c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:16.598206 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f39fe7f5-d05d-4aa1-8300-816e7bbabf4c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:16.598738 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f39fe7f5-d05d-4aa1-8300-816e7bbabf4c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:16.600157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f39fe7f5-d05d-4aa1-8300-816e7bbabf4c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:16.600840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f39fe7f5-d05d-4aa1-8300-816e7bbabf4c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:16.602050 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f39fe7f5-d05d-4aa1-8300-816e7bbabf4c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:16.644013 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d4e08444-7b51-4b38-b07c-82dac3ff8709 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:16.654491 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d4e08444-7b51-4b38-b07c-82dac3ff8709 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:16.656120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d4e08444-7b51-4b38-b07c-82dac3ff8709 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:16.657479 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d4e08444-7b51-4b38-b07c-82dac3ff8709 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.217318 Oct 04 08:52:16.658547 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 60/115] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:16 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:16.797004 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-12290a53-9dca-4273-884e-95b508d6af8a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:16.798502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-12290a53-9dca-4273-884e-95b508d6af8a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:16.807617 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12290a53-9dca-4273-884e-95b508d6af8a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:16.808688 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12290a53-9dca-4273-884e-95b508d6af8a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:16.809223 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12290a53-9dca-4273-884e-95b508d6af8a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:16.810052 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12290a53-9dca-4273-884e-95b508d6af8a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:16.810669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12290a53-9dca-4273-884e-95b508d6af8a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:16.811133 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12290a53-9dca-4273-884e-95b508d6af8a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:16.826951 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f39fe7f5-d05d-4aa1-8300-816e7bbabf4c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:16.835988 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f39fe7f5-d05d-4aa1-8300-816e7bbabf4c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.250878 Oct 04 08:52:16.836679 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 56/116] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:16 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:16.960501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-12290a53-9dca-4273-884e-95b508d6af8a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:16.968761 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-12290a53-9dca-4273-884e-95b508d6af8a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.177547 Oct 04 08:52:16.969628 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 61/117] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:16 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:17.683448 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-27f136fa-0157-45ca-823a-0f0d74dd6c7a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:17.684072 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-27f136fa-0157-45ca-823a-0f0d74dd6c7a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:17.690180 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27f136fa-0157-45ca-823a-0f0d74dd6c7a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:17.690665 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27f136fa-0157-45ca-823a-0f0d74dd6c7a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:17.691096 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27f136fa-0157-45ca-823a-0f0d74dd6c7a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:17.691778 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27f136fa-0157-45ca-823a-0f0d74dd6c7a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:17.692408 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27f136fa-0157-45ca-823a-0f0d74dd6c7a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:17.692825 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27f136fa-0157-45ca-823a-0f0d74dd6c7a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:17.859807 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-27f136fa-0157-45ca-823a-0f0d74dd6c7a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:17.873080 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-27f136fa-0157-45ca-823a-0f0d74dd6c7a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:17.874532 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-27f136fa-0157-45ca-823a-0f0d74dd6c7a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:17.875628 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-27f136fa-0157-45ca-823a-0f0d74dd6c7a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.197111 Oct 04 08:52:17.876606 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 57/118] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:17 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:17.893226 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-09266691-d70a-4061-83ce-e46dbbf50079 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:17.894132 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-09266691-d70a-4061-83ce-e46dbbf50079 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:17.900610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-09266691-d70a-4061-83ce-e46dbbf50079 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:17.901082 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-09266691-d70a-4061-83ce-e46dbbf50079 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:17.901658 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-09266691-d70a-4061-83ce-e46dbbf50079 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:17.902342 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-09266691-d70a-4061-83ce-e46dbbf50079 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:17.902813 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-09266691-d70a-4061-83ce-e46dbbf50079 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:17.903297 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-09266691-d70a-4061-83ce-e46dbbf50079 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:18.056334 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-09266691-d70a-4061-83ce-e46dbbf50079 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:18.066441 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-09266691-d70a-4061-83ce-e46dbbf50079 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.188082 Oct 04 08:52:18.076021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 58/119] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:17 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:18.082989 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6def6c49-7e6f-43dc-b192-926875d74c20 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:18.084417 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-2b11ec19-131f-405d-9a0e-0f1fabad2ff0 req-ae8c9d38-84b1-4045-80bf-e86b1e581101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28f0369-796d-4b75-b047-ccf9a6998560", "name": "network-vif-plugged", "status": "completed", "tag": "5dfb7890-2a06-487d-91f3-6ff8a9259582"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:18.086807 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6def6c49-7e6f-43dc-b192-926875d74c20 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:18.095142 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6def6c49-7e6f-43dc-b192-926875d74c20 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:18.095673 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6def6c49-7e6f-43dc-b192-926875d74c20 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:18.096437 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6def6c49-7e6f-43dc-b192-926875d74c20 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:18.097344 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6def6c49-7e6f-43dc-b192-926875d74c20 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:18.097993 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6def6c49-7e6f-43dc-b192-926875d74c20 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:18.098720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6def6c49-7e6f-43dc-b192-926875d74c20 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:18.100145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-2b11ec19-131f-405d-9a0e-0f1fabad2ff0 req-ae8c9d38-84b1-4045-80bf-e86b1e581101 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:18.100626 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-2b11ec19-131f-405d-9a0e-0f1fabad2ff0 req-ae8c9d38-84b1-4045-80bf-e86b1e581101 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:18.101078 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-2b11ec19-131f-405d-9a0e-0f1fabad2ff0 req-ae8c9d38-84b1-4045-80bf-e86b1e581101 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:18.123835 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-2b11ec19-131f-405d-9a0e-0f1fabad2ff0 req-ae8c9d38-84b1-4045-80bf-e86b1e581101 service nova] Creating event network-vif-plugged:5dfb7890-2a06-487d-91f3-6ff8a9259582 for instance d28f0369-796d-4b75-b047-ccf9a6998560 on hv-cinder-84456 Oct 04 08:52:18.136549 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-2b11ec19-131f-405d-9a0e-0f1fabad2ff0 req-ae8c9d38-84b1-4045-80bf-e86b1e581101 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.396604 Oct 04 08:52:18.137215 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 62/120] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:18.322341 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6def6c49-7e6f-43dc-b192-926875d74c20 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:18.331141 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6def6c49-7e6f-43dc-b192-926875d74c20 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.262756 Oct 04 08:52:18.332708 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 59/121] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:18 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:18.903079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-72d59a83-ff57-43f4-95d1-95faad89ed0a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:18.903782 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-72d59a83-ff57-43f4-95d1-95faad89ed0a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:18.910139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-72d59a83-ff57-43f4-95d1-95faad89ed0a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:18.910679 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-72d59a83-ff57-43f4-95d1-95faad89ed0a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:18.911116 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-72d59a83-ff57-43f4-95d1-95faad89ed0a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:18.911803 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-72d59a83-ff57-43f4-95d1-95faad89ed0a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:18.912293 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-72d59a83-ff57-43f4-95d1-95faad89ed0a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:18.912706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-72d59a83-ff57-43f4-95d1-95faad89ed0a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:18.933516 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=100 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:19.057076 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-72d59a83-ff57-43f4-95d1-95faad89ed0a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:19.068694 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-72d59a83-ff57-43f4-95d1-95faad89ed0a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:19.070493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-72d59a83-ff57-43f4-95d1-95faad89ed0a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:19.071672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-72d59a83-ff57-43f4-95d1-95faad89ed0a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.173390 Oct 04 08:52:19.072342 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 63/122] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:18 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:19.094754 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-bd1c0683-644c-4290-ae7a-f13e3c6f78d6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:19.095478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-bd1c0683-644c-4290-ae7a-f13e3c6f78d6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:19.101667 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bd1c0683-644c-4290-ae7a-f13e3c6f78d6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:19.102158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bd1c0683-644c-4290-ae7a-f13e3c6f78d6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:19.102589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bd1c0683-644c-4290-ae7a-f13e3c6f78d6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:19.103281 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bd1c0683-644c-4290-ae7a-f13e3c6f78d6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:19.103988 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bd1c0683-644c-4290-ae7a-f13e3c6f78d6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:19.104556 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bd1c0683-644c-4290-ae7a-f13e3c6f78d6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:19.250977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-bd1c0683-644c-4290-ae7a-f13e3c6f78d6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:19.261912 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-bd1c0683-644c-4290-ae7a-f13e3c6f78d6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.175467 Oct 04 08:52:19.262719 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 60/123] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:19 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:19.361919 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9206ef11-0276-4a01-ae20-81adc8542f38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:19.362937 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9206ef11-0276-4a01-ae20-81adc8542f38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:19.369938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9206ef11-0276-4a01-ae20-81adc8542f38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:19.371314 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9206ef11-0276-4a01-ae20-81adc8542f38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:19.371930 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9206ef11-0276-4a01-ae20-81adc8542f38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:19.372825 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9206ef11-0276-4a01-ae20-81adc8542f38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:19.373975 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9206ef11-0276-4a01-ae20-81adc8542f38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:19.374559 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9206ef11-0276-4a01-ae20-81adc8542f38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:19.532651 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9206ef11-0276-4a01-ae20-81adc8542f38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:19.540834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9206ef11-0276-4a01-ae20-81adc8542f38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.183692 Oct 04 08:52:19.541425 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 64/124] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:19 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:20.102661 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c0cc320f-8dd6-4d36-965c-a9d44bfe94d7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:20.103431 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c0cc320f-8dd6-4d36-965c-a9d44bfe94d7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:20.120999 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0cc320f-8dd6-4d36-965c-a9d44bfe94d7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:20.120999 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0cc320f-8dd6-4d36-965c-a9d44bfe94d7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:20.120999 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0cc320f-8dd6-4d36-965c-a9d44bfe94d7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:20.120999 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0cc320f-8dd6-4d36-965c-a9d44bfe94d7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:20.121331 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0cc320f-8dd6-4d36-965c-a9d44bfe94d7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:20.121625 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0cc320f-8dd6-4d36-965c-a9d44bfe94d7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:20.265630 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c0cc320f-8dd6-4d36-965c-a9d44bfe94d7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:20.275630 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c0cc320f-8dd6-4d36-965c-a9d44bfe94d7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:20.277104 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c0cc320f-8dd6-4d36-965c-a9d44bfe94d7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:20.280481 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c0cc320f-8dd6-4d36-965c-a9d44bfe94d7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.182033 Oct 04 08:52:20.281614 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 61/125] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:20 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:20.300723 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-130dc923-7267-4fdc-8c88-e0a297df3eb0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:20.301486 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-130dc923-7267-4fdc-8c88-e0a297df3eb0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:20.310783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-130dc923-7267-4fdc-8c88-e0a297df3eb0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:20.311413 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-130dc923-7267-4fdc-8c88-e0a297df3eb0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:20.312012 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-130dc923-7267-4fdc-8c88-e0a297df3eb0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:20.313148 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-130dc923-7267-4fdc-8c88-e0a297df3eb0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:20.313613 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-130dc923-7267-4fdc-8c88-e0a297df3eb0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:20.314043 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-130dc923-7267-4fdc-8c88-e0a297df3eb0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:20.510237 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-130dc923-7267-4fdc-8c88-e0a297df3eb0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:20.521083 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-130dc923-7267-4fdc-8c88-e0a297df3eb0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.239339 Oct 04 08:52:20.525093 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 65/126] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:20 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:20.565505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7c381d53-7981-4503-be1a-bb5da3de0cde tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:20.566251 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7c381d53-7981-4503-be1a-bb5da3de0cde tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:20.574065 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7c381d53-7981-4503-be1a-bb5da3de0cde tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:20.575030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7c381d53-7981-4503-be1a-bb5da3de0cde tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:20.575598 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7c381d53-7981-4503-be1a-bb5da3de0cde tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:20.576907 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7c381d53-7981-4503-be1a-bb5da3de0cde tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:20.578291 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7c381d53-7981-4503-be1a-bb5da3de0cde tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:20.579147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7c381d53-7981-4503-be1a-bb5da3de0cde tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:20.794096 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7c381d53-7981-4503-be1a-bb5da3de0cde tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:20.805107 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7c381d53-7981-4503-be1a-bb5da3de0cde tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.245617 Oct 04 08:52:20.806154 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 62/127] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:20 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:21.306269 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-afb5f3dc-1730-4466-b8d8-ab410e41860f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:21.307179 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-afb5f3dc-1730-4466-b8d8-ab410e41860f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:21.313737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-afb5f3dc-1730-4466-b8d8-ab410e41860f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:21.314380 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-afb5f3dc-1730-4466-b8d8-ab410e41860f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:21.314642 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-afb5f3dc-1730-4466-b8d8-ab410e41860f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:21.315361 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-afb5f3dc-1730-4466-b8d8-ab410e41860f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:21.315812 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-afb5f3dc-1730-4466-b8d8-ab410e41860f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:21.316260 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-afb5f3dc-1730-4466-b8d8-ab410e41860f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:21.498300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-afb5f3dc-1730-4466-b8d8-ab410e41860f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:21.503046 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-afb5f3dc-1730-4466-b8d8-ab410e41860f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:21.504509 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-afb5f3dc-1730-4466-b8d8-ab410e41860f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:21.505615 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-afb5f3dc-1730-4466-b8d8-ab410e41860f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.203364 Oct 04 08:52:21.506140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 66/128] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:21 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:21.546129 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-111ea7f5-cbc3-4776-b239-87aaa3961988 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:21.546753 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-111ea7f5-cbc3-4776-b239-87aaa3961988 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:21.553992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-111ea7f5-cbc3-4776-b239-87aaa3961988 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:21.554508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-111ea7f5-cbc3-4776-b239-87aaa3961988 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:21.554935 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-111ea7f5-cbc3-4776-b239-87aaa3961988 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:21.555777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-111ea7f5-cbc3-4776-b239-87aaa3961988 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:21.556384 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-111ea7f5-cbc3-4776-b239-87aaa3961988 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:21.556915 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-111ea7f5-cbc3-4776-b239-87aaa3961988 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:21.701094 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-111ea7f5-cbc3-4776-b239-87aaa3961988 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:21.709074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-111ea7f5-cbc3-4776-b239-87aaa3961988 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.166955 Oct 04 08:52:21.709639 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 63/129] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:21 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:21.833823 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0e633e1e-ef09-4249-bb1a-9cbde0ca8b2a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:21.834569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0e633e1e-ef09-4249-bb1a-9cbde0ca8b2a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:21.841983 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e633e1e-ef09-4249-bb1a-9cbde0ca8b2a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:21.842927 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e633e1e-ef09-4249-bb1a-9cbde0ca8b2a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:21.843693 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e633e1e-ef09-4249-bb1a-9cbde0ca8b2a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:21.844921 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e633e1e-ef09-4249-bb1a-9cbde0ca8b2a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:21.845418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e633e1e-ef09-4249-bb1a-9cbde0ca8b2a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:21.846045 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e633e1e-ef09-4249-bb1a-9cbde0ca8b2a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:22.007642 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0e633e1e-ef09-4249-bb1a-9cbde0ca8b2a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:22.016108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0e633e1e-ef09-4249-bb1a-9cbde0ca8b2a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.186996 Oct 04 08:52:22.016677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 67/130] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:21 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:22.530113 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6e049e1d-6a55-43f7-af4b-48f345ddbb86 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:22.530745 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6e049e1d-6a55-43f7-af4b-48f345ddbb86 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:22.538173 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e049e1d-6a55-43f7-af4b-48f345ddbb86 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:22.538878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e049e1d-6a55-43f7-af4b-48f345ddbb86 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:22.539521 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e049e1d-6a55-43f7-af4b-48f345ddbb86 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:22.540437 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e049e1d-6a55-43f7-af4b-48f345ddbb86 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:22.541078 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e049e1d-6a55-43f7-af4b-48f345ddbb86 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:22.542171 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e049e1d-6a55-43f7-af4b-48f345ddbb86 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:22.677009 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6e049e1d-6a55-43f7-af4b-48f345ddbb86 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:22.685426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6e049e1d-6a55-43f7-af4b-48f345ddbb86 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:22.686866 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6e049e1d-6a55-43f7-af4b-48f345ddbb86 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:22.688019 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6e049e1d-6a55-43f7-af4b-48f345ddbb86 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.161812 Oct 04 08:52:22.688701 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 64/131] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:22 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:22.731486 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f51ebef3-bed4-4d4e-af4b-917672cd8182 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:22.732126 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f51ebef3-bed4-4d4e-af4b-917672cd8182 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:22.738388 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f51ebef3-bed4-4d4e-af4b-917672cd8182 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:22.738863 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f51ebef3-bed4-4d4e-af4b-917672cd8182 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:22.739286 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f51ebef3-bed4-4d4e-af4b-917672cd8182 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:22.739986 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f51ebef3-bed4-4d4e-af4b-917672cd8182 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:22.740431 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f51ebef3-bed4-4d4e-af4b-917672cd8182 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:22.740842 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f51ebef3-bed4-4d4e-af4b-917672cd8182 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:22.868238 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f51ebef3-bed4-4d4e-af4b-917672cd8182 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:22.875972 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f51ebef3-bed4-4d4e-af4b-917672cd8182 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.148913 Oct 04 08:52:22.876729 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 68/132] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:22 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:23.041366 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d0091a0d-9ef7-489f-9c5c-c9c0e76dae11 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:23.042376 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d0091a0d-9ef7-489f-9c5c-c9c0e76dae11 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:23.048850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0091a0d-9ef7-489f-9c5c-c9c0e76dae11 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:23.049515 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0091a0d-9ef7-489f-9c5c-c9c0e76dae11 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:23.049920 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0091a0d-9ef7-489f-9c5c-c9c0e76dae11 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:23.050612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0091a0d-9ef7-489f-9c5c-c9c0e76dae11 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:23.051061 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0091a0d-9ef7-489f-9c5c-c9c0e76dae11 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:23.051478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0091a0d-9ef7-489f-9c5c-c9c0e76dae11 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:23.224536 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d0091a0d-9ef7-489f-9c5c-c9c0e76dae11 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:23.233116 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d0091a0d-9ef7-489f-9c5c-c9c0e76dae11 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.195750 Oct 04 08:52:23.233824 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 65/133] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:23 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:23.713765 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-87d2e044-0879-4e83-9015-ac17e6df9d60 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:23.714380 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-87d2e044-0879-4e83-9015-ac17e6df9d60 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:23.721367 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87d2e044-0879-4e83-9015-ac17e6df9d60 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:23.722012 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87d2e044-0879-4e83-9015-ac17e6df9d60 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:23.722451 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87d2e044-0879-4e83-9015-ac17e6df9d60 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:23.723291 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87d2e044-0879-4e83-9015-ac17e6df9d60 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:23.724343 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87d2e044-0879-4e83-9015-ac17e6df9d60 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:23.724772 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87d2e044-0879-4e83-9015-ac17e6df9d60 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:23.878739 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-87d2e044-0879-4e83-9015-ac17e6df9d60 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:23.890636 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-87d2e044-0879-4e83-9015-ac17e6df9d60 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:23.893745 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-87d2e044-0879-4e83-9015-ac17e6df9d60 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:23.894889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-87d2e044-0879-4e83-9015-ac17e6df9d60 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.185391 Oct 04 08:52:23.895439 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 69/134] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:23 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:23.899853 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d9cfd04f-ae7c-4f3a-a15b-3b2def754921 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:23.900749 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d9cfd04f-ae7c-4f3a-a15b-3b2def754921 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:23.906715 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9cfd04f-ae7c-4f3a-a15b-3b2def754921 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:23.907267 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9cfd04f-ae7c-4f3a-a15b-3b2def754921 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:23.907865 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9cfd04f-ae7c-4f3a-a15b-3b2def754921 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:23.908581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9cfd04f-ae7c-4f3a-a15b-3b2def754921 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:23.909035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9cfd04f-ae7c-4f3a-a15b-3b2def754921 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:23.909601 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9cfd04f-ae7c-4f3a-a15b-3b2def754921 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:23.913587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=100 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:24.038828 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d9cfd04f-ae7c-4f3a-a15b-3b2def754921 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:24.046618 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d9cfd04f-ae7c-4f3a-a15b-3b2def754921 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.151729 Oct 04 08:52:24.047188 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 66/135] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:23 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:24.258306 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d38ca513-4f31-4abf-94fd-de3a12dae665 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:24.258911 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d38ca513-4f31-4abf-94fd-de3a12dae665 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:24.266368 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d38ca513-4f31-4abf-94fd-de3a12dae665 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:24.267066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d38ca513-4f31-4abf-94fd-de3a12dae665 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:24.268353 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d38ca513-4f31-4abf-94fd-de3a12dae665 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:24.269026 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d38ca513-4f31-4abf-94fd-de3a12dae665 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:24.269449 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d38ca513-4f31-4abf-94fd-de3a12dae665 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:24.270002 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d38ca513-4f31-4abf-94fd-de3a12dae665 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:24.416516 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d38ca513-4f31-4abf-94fd-de3a12dae665 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:24.426626 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d38ca513-4f31-4abf-94fd-de3a12dae665 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.172153 Oct 04 08:52:24.427563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 70/136] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:24 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:24.920401 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-fc8d3be7-e987-4f39-98a3-02751e68858a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:24.921135 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-fc8d3be7-e987-4f39-98a3-02751e68858a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:24.927415 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fc8d3be7-e987-4f39-98a3-02751e68858a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:24.927915 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fc8d3be7-e987-4f39-98a3-02751e68858a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:24.928342 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fc8d3be7-e987-4f39-98a3-02751e68858a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:24.929024 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fc8d3be7-e987-4f39-98a3-02751e68858a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:24.929445 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fc8d3be7-e987-4f39-98a3-02751e68858a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:24.929978 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fc8d3be7-e987-4f39-98a3-02751e68858a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:25.071135 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-59d0c9a0-b5c6-4d67-9aa8-c456f376509f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:25.071733 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-59d0c9a0-b5c6-4d67-9aa8-c456f376509f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:25.074774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-fc8d3be7-e987-4f39-98a3-02751e68858a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:25.078328 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-59d0c9a0-b5c6-4d67-9aa8-c456f376509f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:25.079217 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-59d0c9a0-b5c6-4d67-9aa8-c456f376509f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:25.079655 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-59d0c9a0-b5c6-4d67-9aa8-c456f376509f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:25.080513 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-59d0c9a0-b5c6-4d67-9aa8-c456f376509f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:25.080964 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-59d0c9a0-b5c6-4d67-9aa8-c456f376509f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:25.081673 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-59d0c9a0-b5c6-4d67-9aa8-c456f376509f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:25.086218 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-fc8d3be7-e987-4f39-98a3-02751e68858a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:25.087643 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-fc8d3be7-e987-4f39-98a3-02751e68858a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:25.088806 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-fc8d3be7-e987-4f39-98a3-02751e68858a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.172403 Oct 04 08:52:25.091285 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 67/137] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:24 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:25.226044 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-59d0c9a0-b5c6-4d67-9aa8-c456f376509f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:25.234324 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-59d0c9a0-b5c6-4d67-9aa8-c456f376509f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.168674 Oct 04 08:52:25.235994 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 71/138] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:25 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:25.450815 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ec9294e2-84d1-460a-b317-c04c32787aad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:25.452187 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ec9294e2-84d1-460a-b317-c04c32787aad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:25.458140 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ec9294e2-84d1-460a-b317-c04c32787aad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:25.458619 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ec9294e2-84d1-460a-b317-c04c32787aad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:25.459035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ec9294e2-84d1-460a-b317-c04c32787aad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:25.459873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ec9294e2-84d1-460a-b317-c04c32787aad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:25.460353 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ec9294e2-84d1-460a-b317-c04c32787aad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:25.460763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ec9294e2-84d1-460a-b317-c04c32787aad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:25.602837 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ec9294e2-84d1-460a-b317-c04c32787aad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:25.612904 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ec9294e2-84d1-460a-b317-c04c32787aad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.166191 Oct 04 08:52:25.613537 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 68/139] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:25 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:26.116140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-61246f6e-df79-43cf-899d-6370b5e2cb8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:26.116987 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-61246f6e-df79-43cf-899d-6370b5e2cb8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:26.125258 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-61246f6e-df79-43cf-899d-6370b5e2cb8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:26.125930 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-61246f6e-df79-43cf-899d-6370b5e2cb8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:26.126353 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-61246f6e-df79-43cf-899d-6370b5e2cb8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:26.127057 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-61246f6e-df79-43cf-899d-6370b5e2cb8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:26.127505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-61246f6e-df79-43cf-899d-6370b5e2cb8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:26.127916 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-61246f6e-df79-43cf-899d-6370b5e2cb8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:26.257690 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7f6cd879-d22f-4637-994d-b70187083bc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:26.258354 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7f6cd879-d22f-4637-994d-b70187083bc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:26.259963 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-61246f6e-df79-43cf-899d-6370b5e2cb8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:26.264538 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7f6cd879-d22f-4637-994d-b70187083bc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:26.265023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7f6cd879-d22f-4637-994d-b70187083bc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:26.265440 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7f6cd879-d22f-4637-994d-b70187083bc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:26.266134 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7f6cd879-d22f-4637-994d-b70187083bc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:26.266582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7f6cd879-d22f-4637-994d-b70187083bc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:26.266999 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7f6cd879-d22f-4637-994d-b70187083bc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:26.268164 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-61246f6e-df79-43cf-899d-6370b5e2cb8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:26.269598 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-61246f6e-df79-43cf-899d-6370b5e2cb8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:26.270694 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-61246f6e-df79-43cf-899d-6370b5e2cb8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.160079 Oct 04 08:52:26.271256 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 72/140] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:26 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:26.396611 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7f6cd879-d22f-4637-994d-b70187083bc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:26.404623 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7f6cd879-d22f-4637-994d-b70187083bc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.150936 Oct 04 08:52:26.405193 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 69/141] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:26 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:26.641098 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0e045e86-7d36-4c8e-921a-cc619cbaa577 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:26.642064 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0e045e86-7d36-4c8e-921a-cc619cbaa577 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:26.652488 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e045e86-7d36-4c8e-921a-cc619cbaa577 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:26.653274 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e045e86-7d36-4c8e-921a-cc619cbaa577 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:26.653968 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e045e86-7d36-4c8e-921a-cc619cbaa577 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:26.655101 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e045e86-7d36-4c8e-921a-cc619cbaa577 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:26.655851 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e045e86-7d36-4c8e-921a-cc619cbaa577 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:26.656594 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e045e86-7d36-4c8e-921a-cc619cbaa577 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:26.954337 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0e045e86-7d36-4c8e-921a-cc619cbaa577 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:26.962484 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0e045e86-7d36-4c8e-921a-cc619cbaa577 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.327842 Oct 04 08:52:26.963043 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 73/142] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:26 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:27.299024 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-3c9ce786-666f-435b-89d8-63fb68ed825e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:27.300058 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-3c9ce786-666f-435b-89d8-63fb68ed825e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:27.309967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c9ce786-666f-435b-89d8-63fb68ed825e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.310837 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c9ce786-666f-435b-89d8-63fb68ed825e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.311605 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c9ce786-666f-435b-89d8-63fb68ed825e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.312810 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c9ce786-666f-435b-89d8-63fb68ed825e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.314365 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c9ce786-666f-435b-89d8-63fb68ed825e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.314365 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c9ce786-666f-435b-89d8-63fb68ed825e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.427743 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0da0eca1-9c71-4109-9503-a67e3c70c487 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:27.428441 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0da0eca1-9c71-4109-9503-a67e3c70c487 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:27.435052 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0da0eca1-9c71-4109-9503-a67e3c70c487 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.435745 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0da0eca1-9c71-4109-9503-a67e3c70c487 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.436213 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0da0eca1-9c71-4109-9503-a67e3c70c487 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.436931 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0da0eca1-9c71-4109-9503-a67e3c70c487 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.437415 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0da0eca1-9c71-4109-9503-a67e3c70c487 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.438008 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0da0eca1-9c71-4109-9503-a67e3c70c487 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.445017 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3c9ce786-666f-435b-89d8-63fb68ed825e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:27.454531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3c9ce786-666f-435b-89d8-63fb68ed825e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:27.456345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3c9ce786-666f-435b-89d8-63fb68ed825e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:27.457432 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-3c9ce786-666f-435b-89d8-63fb68ed825e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.165063 Oct 04 08:52:27.458373 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 70/143] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:27 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:27.574939 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0da0eca1-9c71-4109-9503-a67e3c70c487 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:27.583007 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0da0eca1-9c71-4109-9503-a67e3c70c487 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.159247 Oct 04 08:52:27.583548 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 74/144] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:27 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:27.986064 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-efec6ecf-2b1f-4f9f-856f-284cf612d254 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:27.986706 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-efec6ecf-2b1f-4f9f-856f-284cf612d254 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:27.993431 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-efec6ecf-2b1f-4f9f-856f-284cf612d254 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.993908 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-efec6ecf-2b1f-4f9f-856f-284cf612d254 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.994333 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-efec6ecf-2b1f-4f9f-856f-284cf612d254 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.995104 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-efec6ecf-2b1f-4f9f-856f-284cf612d254 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.995793 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-efec6ecf-2b1f-4f9f-856f-284cf612d254 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.996547 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-efec6ecf-2b1f-4f9f-856f-284cf612d254 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.132920 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-efec6ecf-2b1f-4f9f-856f-284cf612d254 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:28.145331 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-efec6ecf-2b1f-4f9f-856f-284cf612d254 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.163260 Oct 04 08:52:28.145891 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 71/145] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:27 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:28.488644 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5ff6621d-613f-45b8-848a-81326bdaec6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:28.489628 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5ff6621d-613f-45b8-848a-81326bdaec6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:28.497308 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ff6621d-613f-45b8-848a-81326bdaec6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:28.497798 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ff6621d-613f-45b8-848a-81326bdaec6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:28.498221 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ff6621d-613f-45b8-848a-81326bdaec6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.498904 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ff6621d-613f-45b8-848a-81326bdaec6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:28.499350 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ff6621d-613f-45b8-848a-81326bdaec6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:28.499769 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ff6621d-613f-45b8-848a-81326bdaec6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.605848 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-11273d69-fa1c-49f7-91cb-d06667fccb82 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:28.606454 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-11273d69-fa1c-49f7-91cb-d06667fccb82 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:28.613089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11273d69-fa1c-49f7-91cb-d06667fccb82 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:28.613575 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11273d69-fa1c-49f7-91cb-d06667fccb82 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:28.614005 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11273d69-fa1c-49f7-91cb-d06667fccb82 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.614666 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11273d69-fa1c-49f7-91cb-d06667fccb82 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:28.615114 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11273d69-fa1c-49f7-91cb-d06667fccb82 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:28.615786 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11273d69-fa1c-49f7-91cb-d06667fccb82 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.633283 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5ff6621d-613f-45b8-848a-81326bdaec6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:28.641937 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5ff6621d-613f-45b8-848a-81326bdaec6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:28.644070 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5ff6621d-613f-45b8-848a-81326bdaec6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:28.646059 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5ff6621d-613f-45b8-848a-81326bdaec6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.164169 Oct 04 08:52:28.646552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 75/146] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:28 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:52:28.745885 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-11273d69-fa1c-49f7-91cb-d06667fccb82 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:28.753872 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-11273d69-fa1c-49f7-91cb-d06667fccb82 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.151911 Oct 04 08:52:28.754441 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 72/147] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:28 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:29.172502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9e9b99aa-306b-4e98-bffc-4056de140622 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:29.173391 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9e9b99aa-306b-4e98-bffc-4056de140622 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:29.182641 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9e9b99aa-306b-4e98-bffc-4056de140622 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.183113 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9e9b99aa-306b-4e98-bffc-4056de140622 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:29.183559 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9e9b99aa-306b-4e98-bffc-4056de140622 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:29.184284 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9e9b99aa-306b-4e98-bffc-4056de140622 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.184737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9e9b99aa-306b-4e98-bffc-4056de140622 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:29.185158 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9e9b99aa-306b-4e98-bffc-4056de140622 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:29.315206 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9e9b99aa-306b-4e98-bffc-4056de140622 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:29.325736 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9e9b99aa-306b-4e98-bffc-4056de140622 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.159565 Oct 04 08:52:29.326540 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 76/148] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:29 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:29.671400 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-602c7bcd-5055-4c0e-85e3-e8a3bdab4432 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:29.672030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-602c7bcd-5055-4c0e-85e3-e8a3bdab4432 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:29.678242 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-602c7bcd-5055-4c0e-85e3-e8a3bdab4432 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.678724 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-602c7bcd-5055-4c0e-85e3-e8a3bdab4432 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:29.679150 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-602c7bcd-5055-4c0e-85e3-e8a3bdab4432 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:29.679836 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-602c7bcd-5055-4c0e-85e3-e8a3bdab4432 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.680318 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-602c7bcd-5055-4c0e-85e3-e8a3bdab4432 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:29.680737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-602c7bcd-5055-4c0e-85e3-e8a3bdab4432 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:29.776639 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ca2a0f82-03a3-4f6f-95f3-749e5b946bdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:29.777349 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ca2a0f82-03a3-4f6f-95f3-749e5b946bdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:29.783705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ca2a0f82-03a3-4f6f-95f3-749e5b946bdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.784093 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ca2a0f82-03a3-4f6f-95f3-749e5b946bdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:29.784524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ca2a0f82-03a3-4f6f-95f3-749e5b946bdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:29.785462 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ca2a0f82-03a3-4f6f-95f3-749e5b946bdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.785923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ca2a0f82-03a3-4f6f-95f3-749e5b946bdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:29.786416 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ca2a0f82-03a3-4f6f-95f3-749e5b946bdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:29.813459 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-602c7bcd-5055-4c0e-85e3-e8a3bdab4432 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:29.821753 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-602c7bcd-5055-4c0e-85e3-e8a3bdab4432 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:29.823212 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-602c7bcd-5055-4c0e-85e3-e8a3bdab4432 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:29.824359 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-602c7bcd-5055-4c0e-85e3-e8a3bdab4432 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.156865 Oct 04 08:52:29.824898 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 73/149] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:29 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:29.911929 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ca2a0f82-03a3-4f6f-95f3-749e5b946bdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:29.920738 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ca2a0f82-03a3-4f6f-95f3-749e5b946bdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.147729 Oct 04 08:52:29.921381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 77/150] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:29 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:30.357033 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d677cbd4-8e7b-45f4-b497-e46e9af937dc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:30.358025 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d677cbd4-8e7b-45f4-b497-e46e9af937dc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:30.367934 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d677cbd4-8e7b-45f4-b497-e46e9af937dc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:30.368872 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d677cbd4-8e7b-45f4-b497-e46e9af937dc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.370098 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d677cbd4-8e7b-45f4-b497-e46e9af937dc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:30.370773 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d677cbd4-8e7b-45f4-b497-e46e9af937dc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:30.371613 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d677cbd4-8e7b-45f4-b497-e46e9af937dc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.372638 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d677cbd4-8e7b-45f4-b497-e46e9af937dc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:30.511423 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d677cbd4-8e7b-45f4-b497-e46e9af937dc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:30.519462 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d677cbd4-8e7b-45f4-b497-e46e9af937dc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.169418 Oct 04 08:52:30.520034 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 74/151] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:30 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:30.849808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ab5fe4f7-e08c-42c1-9811-0ab8e06be8ec tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:30.850532 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ab5fe4f7-e08c-42c1-9811-0ab8e06be8ec tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:30.860877 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ab5fe4f7-e08c-42c1-9811-0ab8e06be8ec tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:30.864019 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ab5fe4f7-e08c-42c1-9811-0ab8e06be8ec tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.864637 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ab5fe4f7-e08c-42c1-9811-0ab8e06be8ec tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:30.865342 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ab5fe4f7-e08c-42c1-9811-0ab8e06be8ec tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:30.865925 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ab5fe4f7-e08c-42c1-9811-0ab8e06be8ec tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.866582 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ab5fe4f7-e08c-42c1-9811-0ab8e06be8ec tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:30.943346 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ead21d87-e373-4466-b30e-b29e8fb1a463 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:30.943982 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ead21d87-e373-4466-b30e-b29e8fb1a463 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:30.950156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ead21d87-e373-4466-b30e-b29e8fb1a463 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:30.950606 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ead21d87-e373-4466-b30e-b29e8fb1a463 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.951047 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ead21d87-e373-4466-b30e-b29e8fb1a463 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:30.952229 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ead21d87-e373-4466-b30e-b29e8fb1a463 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:30.952229 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ead21d87-e373-4466-b30e-b29e8fb1a463 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.952600 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ead21d87-e373-4466-b30e-b29e8fb1a463 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.042754 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ab5fe4f7-e08c-42c1-9811-0ab8e06be8ec tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:31.051179 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ab5fe4f7-e08c-42c1-9811-0ab8e06be8ec tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:31.052664 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ab5fe4f7-e08c-42c1-9811-0ab8e06be8ec tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:31.053752 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ab5fe4f7-e08c-42c1-9811-0ab8e06be8ec tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.208006 Oct 04 08:52:31.054305 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 78/152] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:30 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:31.112359 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ead21d87-e373-4466-b30e-b29e8fb1a463 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:31.125627 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ead21d87-e373-4466-b30e-b29e8fb1a463 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.185800 Oct 04 08:52:31.126695 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 75/153] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:30 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:31.250059 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-abb4ed46-ea5e-47a7-83f0-c70d027e23eb req-2cead6b0-c96e-4ef6-9919-91c2a29b5f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c263bad-2d03-4333-9fa9-89c8df65a642", "name": "network-vif-plugged", "status": "completed", "tag": "df362683-126c-4695-a04d-36d66437dfc5"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:31.261800 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-abb4ed46-ea5e-47a7-83f0-c70d027e23eb req-2cead6b0-c96e-4ef6-9919-91c2a29b5f2e service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:31.262360 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-abb4ed46-ea5e-47a7-83f0-c70d027e23eb req-2cead6b0-c96e-4ef6-9919-91c2a29b5f2e service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:31.262822 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-abb4ed46-ea5e-47a7-83f0-c70d027e23eb req-2cead6b0-c96e-4ef6-9919-91c2a29b5f2e service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.275099 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-abb4ed46-ea5e-47a7-83f0-c70d027e23eb req-2cead6b0-c96e-4ef6-9919-91c2a29b5f2e service nova] Creating event network-vif-plugged:df362683-126c-4695-a04d-36d66437dfc5 for instance 8c263bad-2d03-4333-9fa9-89c8df65a642 on hv-cinder-84456 Oct 04 08:52:31.280339 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-abb4ed46-ea5e-47a7-83f0-c70d027e23eb req-2cead6b0-c96e-4ef6-9919-91c2a29b5f2e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034139 Oct 04 08:52:31.281156 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 79/154] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:31.541929 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-dbc2b821-7377-4197-af78-4cce9dc98574 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:31.542533 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-dbc2b821-7377-4197-af78-4cce9dc98574 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:31.549114 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dbc2b821-7377-4197-af78-4cce9dc98574 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:31.549586 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dbc2b821-7377-4197-af78-4cce9dc98574 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:31.550002 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dbc2b821-7377-4197-af78-4cce9dc98574 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.550684 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dbc2b821-7377-4197-af78-4cce9dc98574 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:31.551131 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dbc2b821-7377-4197-af78-4cce9dc98574 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:31.551547 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dbc2b821-7377-4197-af78-4cce9dc98574 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.682322 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-dbc2b821-7377-4197-af78-4cce9dc98574 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:31.690920 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-dbc2b821-7377-4197-af78-4cce9dc98574 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.152965 Oct 04 08:52:31.691625 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 76/155] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:31 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:32.080101 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-51d96b84-3b6e-4ffb-a65f-324c7f15f4f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:32.081518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-51d96b84-3b6e-4ffb-a65f-324c7f15f4f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:32.095661 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-51d96b84-3b6e-4ffb-a65f-324c7f15f4f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:32.096594 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-51d96b84-3b6e-4ffb-a65f-324c7f15f4f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:32.097399 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-51d96b84-3b6e-4ffb-a65f-324c7f15f4f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:32.098503 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-51d96b84-3b6e-4ffb-a65f-324c7f15f4f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:32.099677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-51d96b84-3b6e-4ffb-a65f-324c7f15f4f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:32.100344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-51d96b84-3b6e-4ffb-a65f-324c7f15f4f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:32.149967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0a60a140-d0b7-4e01-95aa-f6f7a8c8bcf6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:32.150737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0a60a140-d0b7-4e01-95aa-f6f7a8c8bcf6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:32.156985 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a60a140-d0b7-4e01-95aa-f6f7a8c8bcf6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:32.157591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a60a140-d0b7-4e01-95aa-f6f7a8c8bcf6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:32.158124 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a60a140-d0b7-4e01-95aa-f6f7a8c8bcf6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:32.158899 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a60a140-d0b7-4e01-95aa-f6f7a8c8bcf6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:32.159442 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a60a140-d0b7-4e01-95aa-f6f7a8c8bcf6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:32.159974 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a60a140-d0b7-4e01-95aa-f6f7a8c8bcf6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:32.447289 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-51d96b84-3b6e-4ffb-a65f-324c7f15f4f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:32.461706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=100 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:32.479746 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-51d96b84-3b6e-4ffb-a65f-324c7f15f4f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:32.483568 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0a60a140-d0b7-4e01-95aa-f6f7a8c8bcf6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:32.485473 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-51d96b84-3b6e-4ffb-a65f-324c7f15f4f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:32.495025 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-51d96b84-3b6e-4ffb-a65f-324c7f15f4f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.418006 Oct 04 08:52:32.495516 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0a60a140-d0b7-4e01-95aa-f6f7a8c8bcf6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.348622 Oct 04 08:52:32.505399 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 80/156] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:32 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:32.512092 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 77/157] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:32 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:32.717014 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8c5cb5c7-b557-49a3-ae8f-64e94645d896 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:32.717624 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8c5cb5c7-b557-49a3-ae8f-64e94645d896 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:32.723555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8c5cb5c7-b557-49a3-ae8f-64e94645d896 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:32.724063 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8c5cb5c7-b557-49a3-ae8f-64e94645d896 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:32.724495 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8c5cb5c7-b557-49a3-ae8f-64e94645d896 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:32.725142 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8c5cb5c7-b557-49a3-ae8f-64e94645d896 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:32.725800 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8c5cb5c7-b557-49a3-ae8f-64e94645d896 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:32.726455 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8c5cb5c7-b557-49a3-ae8f-64e94645d896 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:32.872204 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8c5cb5c7-b557-49a3-ae8f-64e94645d896 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:32.880154 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8c5cb5c7-b557-49a3-ae8f-64e94645d896 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.167607 Oct 04 08:52:32.881078 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 81/158] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:32 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:33.520259 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ed49dd0e-4367-4310-b62e-fda4c4b12e15 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:33.520849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ed49dd0e-4367-4310-b62e-fda4c4b12e15 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:33.522557 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1de60a60-b2a8-44df-8c58-8ad9525166d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:33.523351 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1de60a60-b2a8-44df-8c58-8ad9525166d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:33.527012 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ed49dd0e-4367-4310-b62e-fda4c4b12e15 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:33.527497 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ed49dd0e-4367-4310-b62e-fda4c4b12e15 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:33.527982 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ed49dd0e-4367-4310-b62e-fda4c4b12e15 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:33.528673 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ed49dd0e-4367-4310-b62e-fda4c4b12e15 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:33.529126 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ed49dd0e-4367-4310-b62e-fda4c4b12e15 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:33.529312 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1de60a60-b2a8-44df-8c58-8ad9525166d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:33.529553 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ed49dd0e-4367-4310-b62e-fda4c4b12e15 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:33.529712 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1de60a60-b2a8-44df-8c58-8ad9525166d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:33.530135 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1de60a60-b2a8-44df-8c58-8ad9525166d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:33.530868 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1de60a60-b2a8-44df-8c58-8ad9525166d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:33.531643 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1de60a60-b2a8-44df-8c58-8ad9525166d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:33.532397 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1de60a60-b2a8-44df-8c58-8ad9525166d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:33.735249 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1de60a60-b2a8-44df-8c58-8ad9525166d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:33.738493 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ed49dd0e-4367-4310-b62e-fda4c4b12e15 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:33.744387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1de60a60-b2a8-44df-8c58-8ad9525166d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:33.745960 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1de60a60-b2a8-44df-8c58-8ad9525166d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:33.746258 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ed49dd0e-4367-4310-b62e-fda4c4b12e15 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.230176 Oct 04 08:52:33.746801 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 78/159] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:33 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:33.747232 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1de60a60-b2a8-44df-8c58-8ad9525166d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.228657 Oct 04 08:52:33.747811 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 82/160] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:33 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:33.902663 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9df9bf1f-cfb6-4c87-95ca-cf6efeca8832 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:33.903264 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9df9bf1f-cfb6-4c87-95ca-cf6efeca8832 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:33.909417 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9df9bf1f-cfb6-4c87-95ca-cf6efeca8832 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:33.909875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9df9bf1f-cfb6-4c87-95ca-cf6efeca8832 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:33.910349 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9df9bf1f-cfb6-4c87-95ca-cf6efeca8832 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:33.910970 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9df9bf1f-cfb6-4c87-95ca-cf6efeca8832 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:33.911419 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9df9bf1f-cfb6-4c87-95ca-cf6efeca8832 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:33.911831 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9df9bf1f-cfb6-4c87-95ca-cf6efeca8832 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:34.061110 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9df9bf1f-cfb6-4c87-95ca-cf6efeca8832 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:34.068651 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-9df9bf1f-cfb6-4c87-95ca-cf6efeca8832 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.170050 Oct 04 08:52:34.069214 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 79/161] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:33 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:34.771863 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f519d02e-7d73-4df8-a390-4f02e887ed7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:34.784092 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-15132275-9e85-445b-84c0-7e77dc0ee029 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:34.784092 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-15132275-9e85-445b-84c0-7e77dc0ee029 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:34.784989 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f519d02e-7d73-4df8-a390-4f02e887ed7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:34.790208 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-15132275-9e85-445b-84c0-7e77dc0ee029 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:34.790349 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f519d02e-7d73-4df8-a390-4f02e887ed7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:34.790451 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-15132275-9e85-445b-84c0-7e77dc0ee029 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:34.790547 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f519d02e-7d73-4df8-a390-4f02e887ed7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:34.790634 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-15132275-9e85-445b-84c0-7e77dc0ee029 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:34.790722 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f519d02e-7d73-4df8-a390-4f02e887ed7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:34.790816 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-15132275-9e85-445b-84c0-7e77dc0ee029 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:34.790901 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f519d02e-7d73-4df8-a390-4f02e887ed7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:34.790983 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-15132275-9e85-445b-84c0-7e77dc0ee029 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:34.791068 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f519d02e-7d73-4df8-a390-4f02e887ed7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:34.791145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-15132275-9e85-445b-84c0-7e77dc0ee029 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:34.791217 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f519d02e-7d73-4df8-a390-4f02e887ed7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:35.004520 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f519d02e-7d73-4df8-a390-4f02e887ed7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:35.006899 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-15132275-9e85-445b-84c0-7e77dc0ee029 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:35.013418 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f519d02e-7d73-4df8-a390-4f02e887ed7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:35.015383 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f519d02e-7d73-4df8-a390-4f02e887ed7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:35.016547 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f519d02e-7d73-4df8-a390-4f02e887ed7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.248760 Oct 04 08:52:35.017127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 80/162] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:34 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:35.022325 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-15132275-9e85-445b-84c0-7e77dc0ee029 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.256207 Oct 04 08:52:35.025378 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 83/163] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:34 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:35.094906 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-729574e2-4014-434b-9f0b-5264fa75bb0b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:35.095520 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-729574e2-4014-434b-9f0b-5264fa75bb0b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:35.101510 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-729574e2-4014-434b-9f0b-5264fa75bb0b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:35.101987 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-729574e2-4014-434b-9f0b-5264fa75bb0b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:35.102468 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-729574e2-4014-434b-9f0b-5264fa75bb0b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:35.103152 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-729574e2-4014-434b-9f0b-5264fa75bb0b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:35.103595 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-729574e2-4014-434b-9f0b-5264fa75bb0b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:35.104038 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-729574e2-4014-434b-9f0b-5264fa75bb0b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:35.242509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-729574e2-4014-434b-9f0b-5264fa75bb0b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:35.251377 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-729574e2-4014-434b-9f0b-5264fa75bb0b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.163555 Oct 04 08:52:35.264345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 81/164] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:35 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:36.042526 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9df44cbc-2e8a-4565-aa57-d8000a2b602a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:36.049348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-76ebf5ee-c676-4250-9458-ac903f034a1c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:36.049945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-76ebf5ee-c676-4250-9458-ac903f034a1c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:36.053630 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9df44cbc-2e8a-4565-aa57-d8000a2b602a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:36.059537 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-76ebf5ee-c676-4250-9458-ac903f034a1c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:36.059921 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9df44cbc-2e8a-4565-aa57-d8000a2b602a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:36.060270 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-76ebf5ee-c676-4250-9458-ac903f034a1c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:36.060406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9df44cbc-2e8a-4565-aa57-d8000a2b602a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:36.060681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-76ebf5ee-c676-4250-9458-ac903f034a1c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:36.061036 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9df44cbc-2e8a-4565-aa57-d8000a2b602a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:36.061553 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-76ebf5ee-c676-4250-9458-ac903f034a1c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:36.061713 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9df44cbc-2e8a-4565-aa57-d8000a2b602a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:36.061983 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-76ebf5ee-c676-4250-9458-ac903f034a1c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:36.062359 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9df44cbc-2e8a-4565-aa57-d8000a2b602a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:36.062560 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-76ebf5ee-c676-4250-9458-ac903f034a1c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:36.062810 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9df44cbc-2e8a-4565-aa57-d8000a2b602a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:36.260221 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9df44cbc-2e8a-4565-aa57-d8000a2b602a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:36.264837 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-76ebf5ee-c676-4250-9458-ac903f034a1c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:36.268318 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=100 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:36.268948 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9df44cbc-2e8a-4565-aa57-d8000a2b602a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:36.270723 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9df44cbc-2e8a-4565-aa57-d8000a2b602a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:36.271910 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9df44cbc-2e8a-4565-aa57-d8000a2b602a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.235090 Oct 04 08:52:36.272467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 84/165] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:36 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:36.276194 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-76ebf5ee-c676-4250-9458-ac903f034a1c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.231439 Oct 04 08:52:36.277002 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e08d3eaf-9e0e-4ef1-ba4e-ff1d60d9922a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:36.277367 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 82/166] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:36 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:36.278530 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e08d3eaf-9e0e-4ef1-ba4e-ff1d60d9922a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:36.287089 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e08d3eaf-9e0e-4ef1-ba4e-ff1d60d9922a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:36.287746 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e08d3eaf-9e0e-4ef1-ba4e-ff1d60d9922a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:36.288387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e08d3eaf-9e0e-4ef1-ba4e-ff1d60d9922a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:36.289184 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e08d3eaf-9e0e-4ef1-ba4e-ff1d60d9922a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:36.289881 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e08d3eaf-9e0e-4ef1-ba4e-ff1d60d9922a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:36.290395 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e08d3eaf-9e0e-4ef1-ba4e-ff1d60d9922a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:36.419445 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e08d3eaf-9e0e-4ef1-ba4e-ff1d60d9922a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:36.427461 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e08d3eaf-9e0e-4ef1-ba4e-ff1d60d9922a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.154016 Oct 04 08:52:36.428071 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 85/167] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:36 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:37.301517 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9efe3b8d-32bf-4465-9bc0-65e994f42164 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:37.302500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9efe3b8d-32bf-4465-9bc0-65e994f42164 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:37.302925 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0710cda0-b44f-4659-ace3-1e7dc4b1bc40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:37.304099 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0710cda0-b44f-4659-ace3-1e7dc4b1bc40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:37.310356 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9efe3b8d-32bf-4465-9bc0-65e994f42164 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:37.310851 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9efe3b8d-32bf-4465-9bc0-65e994f42164 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:37.311271 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9efe3b8d-32bf-4465-9bc0-65e994f42164 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:37.311981 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9efe3b8d-32bf-4465-9bc0-65e994f42164 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:37.312425 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9efe3b8d-32bf-4465-9bc0-65e994f42164 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:37.313081 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9efe3b8d-32bf-4465-9bc0-65e994f42164 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:37.314389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0710cda0-b44f-4659-ace3-1e7dc4b1bc40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:37.314878 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0710cda0-b44f-4659-ace3-1e7dc4b1bc40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:37.315289 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0710cda0-b44f-4659-ace3-1e7dc4b1bc40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:37.316031 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0710cda0-b44f-4659-ace3-1e7dc4b1bc40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:37.316463 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0710cda0-b44f-4659-ace3-1e7dc4b1bc40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:37.316881 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0710cda0-b44f-4659-ace3-1e7dc4b1bc40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:37.503176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9efe3b8d-32bf-4465-9bc0-65e994f42164 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:37.508414 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0710cda0-b44f-4659-ace3-1e7dc4b1bc40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:37.514680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9efe3b8d-32bf-4465-9bc0-65e994f42164 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:37.516860 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9efe3b8d-32bf-4465-9bc0-65e994f42164 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:37.518525 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-9efe3b8d-32bf-4465-9bc0-65e994f42164 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.223886 Oct 04 08:52:37.519268 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0710cda0-b44f-4659-ace3-1e7dc4b1bc40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.222838 Oct 04 08:52:37.519393 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 83/168] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:37 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:37.520023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 86/169] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:37 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:37.523728 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b88b1fe3-4de5-44a1-ae68-984fd350c51b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:37.524352 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b88b1fe3-4de5-44a1-ae68-984fd350c51b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:37.530645 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b88b1fe3-4de5-44a1-ae68-984fd350c51b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:37.531226 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b88b1fe3-4de5-44a1-ae68-984fd350c51b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:37.531748 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b88b1fe3-4de5-44a1-ae68-984fd350c51b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:37.532580 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b88b1fe3-4de5-44a1-ae68-984fd350c51b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:37.533119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b88b1fe3-4de5-44a1-ae68-984fd350c51b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:37.533620 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b88b1fe3-4de5-44a1-ae68-984fd350c51b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:37.669255 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b88b1fe3-4de5-44a1-ae68-984fd350c51b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:37.677385 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b88b1fe3-4de5-44a1-ae68-984fd350c51b tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.157122 Oct 04 08:52:37.677959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 84/170] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:37 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:38.544325 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-60d6d5c3-c85f-4275-89ca-43b6411119bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:38.545038 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-60d6d5c3-c85f-4275-89ca-43b6411119bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:38.545374 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-71dac97d-cbe0-4641-a865-c248969d71af tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:38.545980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-71dac97d-cbe0-4641-a865-c248969d71af tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:38.551053 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-60d6d5c3-c85f-4275-89ca-43b6411119bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:38.551706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-60d6d5c3-c85f-4275-89ca-43b6411119bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:38.552005 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-60d6d5c3-c85f-4275-89ca-43b6411119bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:38.552724 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-60d6d5c3-c85f-4275-89ca-43b6411119bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:38.552905 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-71dac97d-cbe0-4641-a865-c248969d71af tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:38.553173 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-60d6d5c3-c85f-4275-89ca-43b6411119bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:38.553569 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-71dac97d-cbe0-4641-a865-c248969d71af tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:38.553705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-60d6d5c3-c85f-4275-89ca-43b6411119bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:38.554004 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-71dac97d-cbe0-4641-a865-c248969d71af tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:38.554696 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-71dac97d-cbe0-4641-a865-c248969d71af tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:38.555144 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-71dac97d-cbe0-4641-a865-c248969d71af tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:38.555574 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-71dac97d-cbe0-4641-a865-c248969d71af tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:38.746014 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-71dac97d-cbe0-4641-a865-c248969d71af tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:38.749389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-60d6d5c3-c85f-4275-89ca-43b6411119bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:38.755211 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-71dac97d-cbe0-4641-a865-c248969d71af tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:38.756692 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-71dac97d-cbe0-4641-a865-c248969d71af tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:38.757236 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-60d6d5c3-c85f-4275-89ca-43b6411119bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.217691 Oct 04 08:52:38.757782 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-71dac97d-cbe0-4641-a865-c248969d71af tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.216619 Oct 04 08:52:38.757942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 87/171] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:38 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:38.758764 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 85/172] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:38 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:38.762291 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-05b4a2b9-f880-4dbe-8994-07a16e0d1eb3 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:38.763097 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-05b4a2b9-f880-4dbe-8994-07a16e0d1eb3 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:38.768912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-05b4a2b9-f880-4dbe-8994-07a16e0d1eb3 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:38.769405 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-05b4a2b9-f880-4dbe-8994-07a16e0d1eb3 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:38.769831 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-05b4a2b9-f880-4dbe-8994-07a16e0d1eb3 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:38.770686 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-05b4a2b9-f880-4dbe-8994-07a16e0d1eb3 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:38.771135 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-05b4a2b9-f880-4dbe-8994-07a16e0d1eb3 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:38.771530 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-05b4a2b9-f880-4dbe-8994-07a16e0d1eb3 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:38.907020 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-05b4a2b9-f880-4dbe-8994-07a16e0d1eb3 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:38.914843 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-05b4a2b9-f880-4dbe-8994-07a16e0d1eb3 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.156077 Oct 04 08:52:38.915418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 88/173] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:38 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:39.058515 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-0576ca1c-362e-41e7-be79-ed4c5558e556 req-d2217301-ee40-41ff-815b-ce408a706cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e21016-5037-4bd1-91c6-97ab1b413e06", "name": "network-vif-plugged", "status": "completed", "tag": "df43f084-777f-4af6-b2a6-2d0d23572e5e"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:39.069616 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-0576ca1c-362e-41e7-be79-ed4c5558e556 req-d2217301-ee40-41ff-815b-ce408a706cd4 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:39.070499 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-0576ca1c-362e-41e7-be79-ed4c5558e556 req-d2217301-ee40-41ff-815b-ce408a706cd4 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:39.071140 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-0576ca1c-362e-41e7-be79-ed4c5558e556 req-d2217301-ee40-41ff-815b-ce408a706cd4 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:39.083862 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-0576ca1c-362e-41e7-be79-ed4c5558e556 req-d2217301-ee40-41ff-815b-ce408a706cd4 service nova] Creating event network-vif-plugged:df43f084-777f-4af6-b2a6-2d0d23572e5e for instance 69e21016-5037-4bd1-91c6-97ab1b413e06 on hv-cinder-84456 Oct 04 08:52:39.089368 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-0576ca1c-362e-41e7-be79-ed4c5558e556 req-d2217301-ee40-41ff-815b-ce408a706cd4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034956 Oct 04 08:52:39.089967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 86/174] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:52:39.783427 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-cd9918f5-c627-44a9-85fa-a5a15db56175 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:39.784420 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cd9918f5-c627-44a9-85fa-a5a15db56175 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:39.788965 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5ed3bc24-1c42-404e-87e2-864b381689ff tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:39.790296 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5ed3bc24-1c42-404e-87e2-864b381689ff tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:39.796483 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd9918f5-c627-44a9-85fa-a5a15db56175 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:39.796980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd9918f5-c627-44a9-85fa-a5a15db56175 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:39.799179 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd9918f5-c627-44a9-85fa-a5a15db56175 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:39.800058 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd9918f5-c627-44a9-85fa-a5a15db56175 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:39.800511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd9918f5-c627-44a9-85fa-a5a15db56175 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:39.800930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd9918f5-c627-44a9-85fa-a5a15db56175 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:39.808120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ed3bc24-1c42-404e-87e2-864b381689ff tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:39.810056 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ed3bc24-1c42-404e-87e2-864b381689ff tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:39.812642 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ed3bc24-1c42-404e-87e2-864b381689ff tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:39.813663 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ed3bc24-1c42-404e-87e2-864b381689ff tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:39.826270 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ed3bc24-1c42-404e-87e2-864b381689ff tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:39.826824 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ed3bc24-1c42-404e-87e2-864b381689ff tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:40.110313 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5ed3bc24-1c42-404e-87e2-864b381689ff tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:40.129724 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5ed3bc24-1c42-404e-87e2-864b381689ff tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.352728 Oct 04 08:52:40.132232 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 89/175] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:39 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:40.141387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cd9918f5-c627-44a9-85fa-a5a15db56175 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:40.166022 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cd9918f5-c627-44a9-85fa-a5a15db56175 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:40.167739 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-83b6ab6c-77de-434e-ad14-505157d04436 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:40.168745 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-83b6ab6c-77de-434e-ad14-505157d04436 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:40.171970 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cd9918f5-c627-44a9-85fa-a5a15db56175 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:40.174624 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-cd9918f5-c627-44a9-85fa-a5a15db56175 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.395545 Oct 04 08:52:40.178295 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 87/176] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:39 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:40.187329 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-83b6ab6c-77de-434e-ad14-505157d04436 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:40.188050 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-83b6ab6c-77de-434e-ad14-505157d04436 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:40.188689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-83b6ab6c-77de-434e-ad14-505157d04436 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:40.189701 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-83b6ab6c-77de-434e-ad14-505157d04436 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:40.190391 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-83b6ab6c-77de-434e-ad14-505157d04436 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:40.190983 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-83b6ab6c-77de-434e-ad14-505157d04436 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:40.377057 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-83b6ab6c-77de-434e-ad14-505157d04436 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:40.385390 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-83b6ab6c-77de-434e-ad14-505157d04436 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1315 microversion: 2.1 time: 0.251923 Oct 04 08:52:40.386111 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 90/177] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:40 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:41.156527 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-23b04f26-8f6e-47d5-8f81-d5433479d290 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:41.157178 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-23b04f26-8f6e-47d5-8f81-d5433479d290 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:41.163498 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23b04f26-8f6e-47d5-8f81-d5433479d290 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:41.164050 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23b04f26-8f6e-47d5-8f81-d5433479d290 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:41.164487 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23b04f26-8f6e-47d5-8f81-d5433479d290 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:41.165178 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23b04f26-8f6e-47d5-8f81-d5433479d290 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:41.165865 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23b04f26-8f6e-47d5-8f81-d5433479d290 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:41.166460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23b04f26-8f6e-47d5-8f81-d5433479d290 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:41.201184 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-63d708e3-cccd-4436-8df3-7325e5d4ebba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:41.202407 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-63d708e3-cccd-4436-8df3-7325e5d4ebba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:41.211930 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63d708e3-cccd-4436-8df3-7325e5d4ebba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:41.212699 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63d708e3-cccd-4436-8df3-7325e5d4ebba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:41.213276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63d708e3-cccd-4436-8df3-7325e5d4ebba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:41.221672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63d708e3-cccd-4436-8df3-7325e5d4ebba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:41.226161 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63d708e3-cccd-4436-8df3-7325e5d4ebba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:41.226907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63d708e3-cccd-4436-8df3-7325e5d4ebba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:41.581857 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-23b04f26-8f6e-47d5-8f81-d5433479d290 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:41.591740 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-23b04f26-8f6e-47d5-8f81-d5433479d290 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.439204 Oct 04 08:52:41.592949 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 88/178] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:41 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:41.608437 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-63d708e3-cccd-4436-8df3-7325e5d4ebba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:41.608980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-fa9e0e0b-7bcc-4233-95e3-84d74b94aa02 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:41.609740 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-fa9e0e0b-7bcc-4233-95e3-84d74b94aa02 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:41.612593 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=75 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:41.617400 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-63d708e3-cccd-4436-8df3-7325e5d4ebba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:41.618749 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fa9e0e0b-7bcc-4233-95e3-84d74b94aa02 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:41.618913 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-63d708e3-cccd-4436-8df3-7325e5d4ebba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:41.619557 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fa9e0e0b-7bcc-4233-95e3-84d74b94aa02 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:41.620072 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-63d708e3-cccd-4436-8df3-7325e5d4ebba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.423757 Oct 04 08:52:41.620333 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fa9e0e0b-7bcc-4233-95e3-84d74b94aa02 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:41.621194 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fa9e0e0b-7bcc-4233-95e3-84d74b94aa02 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:41.621784 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fa9e0e0b-7bcc-4233-95e3-84d74b94aa02 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:41.622346 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fa9e0e0b-7bcc-4233-95e3-84d74b94aa02 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:41.633291 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 91/179] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:41 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:52:41.793566 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-fa9e0e0b-7bcc-4233-95e3-84d74b94aa02 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:41.802527 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-fa9e0e0b-7bcc-4233-95e3-84d74b94aa02 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1501 microversion: 2.1 time: 0.208363 Oct 04 08:52:41.803250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 89/180] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:41 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1501 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:42.615025 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-7da16639-efac-4b06-af5c-52e59f498fb4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:42.615580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-7da16639-efac-4b06-af5c-52e59f498fb4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:42.617552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=80 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:42.622953 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7da16639-efac-4b06-af5c-52e59f498fb4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:42.623451 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7da16639-efac-4b06-af5c-52e59f498fb4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:42.623917 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7da16639-efac-4b06-af5c-52e59f498fb4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:42.624606 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7da16639-efac-4b06-af5c-52e59f498fb4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:42.625066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7da16639-efac-4b06-af5c-52e59f498fb4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:42.625506 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7da16639-efac-4b06-af5c-52e59f498fb4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:42.648683 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-80d07cb3-5637-45cc-9f75-c42642513ec2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:42.649471 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-80d07cb3-5637-45cc-9f75-c42642513ec2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:42.657518 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-80d07cb3-5637-45cc-9f75-c42642513ec2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:42.658010 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-80d07cb3-5637-45cc-9f75-c42642513ec2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:42.658450 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-80d07cb3-5637-45cc-9f75-c42642513ec2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:42.659257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-80d07cb3-5637-45cc-9f75-c42642513ec2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:42.659919 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-80d07cb3-5637-45cc-9f75-c42642513ec2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:42.660336 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-80d07cb3-5637-45cc-9f75-c42642513ec2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:42.811798 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7da16639-efac-4b06-af5c-52e59f498fb4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:42.822936 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-7da16639-efac-4b06-af5c-52e59f498fb4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.212105 Oct 04 08:52:42.823720 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 92/181] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:42 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:42.844756 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-80d07cb3-5637-45cc-9f75-c42642513ec2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:42.853129 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-80d07cb3-5637-45cc-9f75-c42642513ec2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:42.854840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-80d07cb3-5637-45cc-9f75-c42642513ec2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:42.856195 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-80d07cb3-5637-45cc-9f75-c42642513ec2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.212892 Oct 04 08:52:42.872516 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 90/182] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:42 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:43.847555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4b937f8b-ff3c-4368-a5d2-7021f0d4d8e2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:43.848170 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4b937f8b-ff3c-4368-a5d2-7021f0d4d8e2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:43.854646 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b937f8b-ff3c-4368-a5d2-7021f0d4d8e2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:43.855218 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b937f8b-ff3c-4368-a5d2-7021f0d4d8e2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:43.855670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b937f8b-ff3c-4368-a5d2-7021f0d4d8e2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:43.856371 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b937f8b-ff3c-4368-a5d2-7021f0d4d8e2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:43.856812 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b937f8b-ff3c-4368-a5d2-7021f0d4d8e2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:43.857224 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b937f8b-ff3c-4368-a5d2-7021f0d4d8e2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:43.884752 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9007a0b2-4c63-4180-927f-9899b986669b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:43.886810 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9007a0b2-4c63-4180-927f-9899b986669b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:43.895775 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9007a0b2-4c63-4180-927f-9899b986669b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:43.896671 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9007a0b2-4c63-4180-927f-9899b986669b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:43.897532 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9007a0b2-4c63-4180-927f-9899b986669b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:43.898529 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9007a0b2-4c63-4180-927f-9899b986669b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:43.899186 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9007a0b2-4c63-4180-927f-9899b986669b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:43.899929 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9007a0b2-4c63-4180-927f-9899b986669b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:44.048887 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4b937f8b-ff3c-4368-a5d2-7021f0d4d8e2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:44.057497 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4b937f8b-ff3c-4368-a5d2-7021f0d4d8e2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.213773 Oct 04 08:52:44.058214 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 93/183] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:43 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:44.097602 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9007a0b2-4c63-4180-927f-9899b986669b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:44.105677 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9007a0b2-4c63-4180-927f-9899b986669b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:44.107114 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9007a0b2-4c63-4180-927f-9899b986669b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:44.108267 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-9007a0b2-4c63-4180-927f-9899b986669b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.228630 Oct 04 08:52:44.108823 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 91/184] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:43 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:45.082940 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-44233edd-fd43-4c25-a631-fc5afcc61b7f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:45.083546 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-44233edd-fd43-4c25-a631-fc5afcc61b7f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:45.089781 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-44233edd-fd43-4c25-a631-fc5afcc61b7f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:45.090259 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-44233edd-fd43-4c25-a631-fc5afcc61b7f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:45.090688 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-44233edd-fd43-4c25-a631-fc5afcc61b7f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:45.091370 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-44233edd-fd43-4c25-a631-fc5afcc61b7f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:45.091814 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-44233edd-fd43-4c25-a631-fc5afcc61b7f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:45.092262 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-44233edd-fd43-4c25-a631-fc5afcc61b7f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:45.134114 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7ae2d505-9d5e-41a9-92f4-5f2481f32d26 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:45.134838 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7ae2d505-9d5e-41a9-92f4-5f2481f32d26 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:45.142704 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7ae2d505-9d5e-41a9-92f4-5f2481f32d26 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:45.143195 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7ae2d505-9d5e-41a9-92f4-5f2481f32d26 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:45.143626 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7ae2d505-9d5e-41a9-92f4-5f2481f32d26 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:45.145027 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7ae2d505-9d5e-41a9-92f4-5f2481f32d26 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:45.145475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7ae2d505-9d5e-41a9-92f4-5f2481f32d26 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:45.145890 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7ae2d505-9d5e-41a9-92f4-5f2481f32d26 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:45.275172 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-44233edd-fd43-4c25-a631-fc5afcc61b7f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:45.284177 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-44233edd-fd43-4c25-a631-fc5afcc61b7f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.205112 Oct 04 08:52:45.293689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 94/185] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:45 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:45.329655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7ae2d505-9d5e-41a9-92f4-5f2481f32d26 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:45.338969 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7ae2d505-9d5e-41a9-92f4-5f2481f32d26 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:45.346943 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7ae2d505-9d5e-41a9-92f4-5f2481f32d26 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:45.348153 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7ae2d505-9d5e-41a9-92f4-5f2481f32d26 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.217947 Oct 04 08:52:45.348724 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 92/186] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:45 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:52:46.309778 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1b8d28fb-bee5-46d1-9ed5-a7e3f5968b0a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:46.310489 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1b8d28fb-bee5-46d1-9ed5-a7e3f5968b0a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:46.316589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1b8d28fb-bee5-46d1-9ed5-a7e3f5968b0a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:46.317140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1b8d28fb-bee5-46d1-9ed5-a7e3f5968b0a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:46.317651 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1b8d28fb-bee5-46d1-9ed5-a7e3f5968b0a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:46.318390 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1b8d28fb-bee5-46d1-9ed5-a7e3f5968b0a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:46.318899 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1b8d28fb-bee5-46d1-9ed5-a7e3f5968b0a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:46.319367 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1b8d28fb-bee5-46d1-9ed5-a7e3f5968b0a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:46.373909 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7f4546d2-7717-459d-8f81-258ec24b5474 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:46.374577 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7f4546d2-7717-459d-8f81-258ec24b5474 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:46.391534 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7f4546d2-7717-459d-8f81-258ec24b5474 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:46.391931 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7f4546d2-7717-459d-8f81-258ec24b5474 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:46.392360 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7f4546d2-7717-459d-8f81-258ec24b5474 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:46.393060 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7f4546d2-7717-459d-8f81-258ec24b5474 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:46.393512 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7f4546d2-7717-459d-8f81-258ec24b5474 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:46.393930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7f4546d2-7717-459d-8f81-258ec24b5474 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:46.581769 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1b8d28fb-bee5-46d1-9ed5-a7e3f5968b0a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:46.596001 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1b8d28fb-bee5-46d1-9ed5-a7e3f5968b0a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.290084 Oct 04 08:52:46.599128 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 95/187] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:46 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:46.639875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7f4546d2-7717-459d-8f81-258ec24b5474 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:46.650626 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7f4546d2-7717-459d-8f81-258ec24b5474 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:46.652411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7f4546d2-7717-459d-8f81-258ec24b5474 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:46.653864 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7f4546d2-7717-459d-8f81-258ec24b5474 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.284089 Oct 04 08:52:46.654583 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 93/188] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:46 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:52:47.635717 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6ea5324c-16e9-4c6f-af24-4c8f0d5ebe48 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:47.636354 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6ea5324c-16e9-4c6f-af24-4c8f0d5ebe48 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:47.642503 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6ea5324c-16e9-4c6f-af24-4c8f0d5ebe48 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:47.643005 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6ea5324c-16e9-4c6f-af24-4c8f0d5ebe48 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:47.643430 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6ea5324c-16e9-4c6f-af24-4c8f0d5ebe48 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:47.644145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6ea5324c-16e9-4c6f-af24-4c8f0d5ebe48 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:47.644873 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6ea5324c-16e9-4c6f-af24-4c8f0d5ebe48 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:47.645014 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6ea5324c-16e9-4c6f-af24-4c8f0d5ebe48 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:47.679324 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e6d377dc-d80d-4097-9ed6-27378d9fd5bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:47.679983 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e6d377dc-d80d-4097-9ed6-27378d9fd5bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:47.692887 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6d377dc-d80d-4097-9ed6-27378d9fd5bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:47.693390 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6d377dc-d80d-4097-9ed6-27378d9fd5bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:47.694105 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6d377dc-d80d-4097-9ed6-27378d9fd5bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:47.694948 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6d377dc-d80d-4097-9ed6-27378d9fd5bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:47.695551 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6d377dc-d80d-4097-9ed6-27378d9fd5bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:47.696129 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6d377dc-d80d-4097-9ed6-27378d9fd5bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:47.825132 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6ea5324c-16e9-4c6f-af24-4c8f0d5ebe48 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:47.832655 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6ea5324c-16e9-4c6f-af24-4c8f0d5ebe48 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.201235 Oct 04 08:52:47.833207 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 96/189] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:47 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:47.866264 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e6d377dc-d80d-4097-9ed6-27378d9fd5bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:47.874486 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e6d377dc-d80d-4097-9ed6-27378d9fd5bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:47.875930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e6d377dc-d80d-4097-9ed6-27378d9fd5bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:47.877016 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e6d377dc-d80d-4097-9ed6-27378d9fd5bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.201688 Oct 04 08:52:47.877579 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 94/190] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:47 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:52:48.696808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fe4a9955-9224-4e0e-ab94-ac471a54aadd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a10137a5-ca6c-443d-9f60-d1e58afe0824"}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:48.699252 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-fe4a9955-9224-4e0e-ab94-ac471a54aadd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:48.705413 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fe4a9955-9224-4e0e-ab94-ac471a54aadd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:48.705901 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fe4a9955-9224-4e0e-ab94-ac471a54aadd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:48.706312 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fe4a9955-9224-4e0e-ab94-ac471a54aadd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:48.706983 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fe4a9955-9224-4e0e-ab94-ac471a54aadd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:48.707420 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fe4a9955-9224-4e0e-ab94-ac471a54aadd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:48.707829 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fe4a9955-9224-4e0e-ab94-ac471a54aadd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:48.761684 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=100 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:48.855066 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-820e5b7e-cba9-4eb5-9213-49d5a504f188 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:48.856446 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-820e5b7e-cba9-4eb5-9213-49d5a504f188 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:48.868150 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-820e5b7e-cba9-4eb5-9213-49d5a504f188 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:48.868679 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-820e5b7e-cba9-4eb5-9213-49d5a504f188 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:48.869100 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-820e5b7e-cba9-4eb5-9213-49d5a504f188 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:48.869858 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-820e5b7e-cba9-4eb5-9213-49d5a504f188 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:48.871211 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-820e5b7e-cba9-4eb5-9213-49d5a504f188 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:48.871631 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-820e5b7e-cba9-4eb5-9213-49d5a504f188 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:49.026035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-820e5b7e-cba9-4eb5-9213-49d5a504f188 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:49.034684 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-820e5b7e-cba9-4eb5-9213-49d5a504f188 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.183932 Oct 04 08:52:49.035783 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 95/191] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:48 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:49.041446 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6429693a-a430-4103-b97a-662e05fcdb50 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:49.042180 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6429693a-a430-4103-b97a-662e05fcdb50 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:49.050152 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6429693a-a430-4103-b97a-662e05fcdb50 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:49.050727 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6429693a-a430-4103-b97a-662e05fcdb50 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:49.051204 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6429693a-a430-4103-b97a-662e05fcdb50 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:49.052108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6429693a-a430-4103-b97a-662e05fcdb50 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:49.052559 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6429693a-a430-4103-b97a-662e05fcdb50 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:49.053144 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6429693a-a430-4103-b97a-662e05fcdb50 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:49.200395 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6429693a-a430-4103-b97a-662e05fcdb50 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:49.210210 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6429693a-a430-4103-b97a-662e05fcdb50 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:49.211662 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6429693a-a430-4103-b97a-662e05fcdb50 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:49.212790 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6429693a-a430-4103-b97a-662e05fcdb50 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.175964 Oct 04 08:52:49.217715 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 96/192] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:49 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:50.060987 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-64500acf-bc7c-42bc-b9f2-1a5887a3255b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:50.062049 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-64500acf-bc7c-42bc-b9f2-1a5887a3255b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:50.073515 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-64500acf-bc7c-42bc-b9f2-1a5887a3255b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:50.074143 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-64500acf-bc7c-42bc-b9f2-1a5887a3255b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:50.074639 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-64500acf-bc7c-42bc-b9f2-1a5887a3255b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:50.075879 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-64500acf-bc7c-42bc-b9f2-1a5887a3255b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:50.076421 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-64500acf-bc7c-42bc-b9f2-1a5887a3255b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:50.077009 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-64500acf-bc7c-42bc-b9f2-1a5887a3255b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:50.250965 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-64500acf-bc7c-42bc-b9f2-1a5887a3255b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:50.262669 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-64500acf-bc7c-42bc-b9f2-1a5887a3255b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.206438 Oct 04 08:52:50.266985 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 97/193] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:50 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:50.272776 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-266da6fc-cf7a-40d0-a1d8-2ed8e7b93194 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:50.273774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-266da6fc-cf7a-40d0-a1d8-2ed8e7b93194 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:50.281722 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-266da6fc-cf7a-40d0-a1d8-2ed8e7b93194 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:50.282217 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-266da6fc-cf7a-40d0-a1d8-2ed8e7b93194 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:50.282821 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-266da6fc-cf7a-40d0-a1d8-2ed8e7b93194 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:50.283793 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-266da6fc-cf7a-40d0-a1d8-2ed8e7b93194 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:50.284402 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-266da6fc-cf7a-40d0-a1d8-2ed8e7b93194 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:50.284962 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-266da6fc-cf7a-40d0-a1d8-2ed8e7b93194 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:50.424020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-266da6fc-cf7a-40d0-a1d8-2ed8e7b93194 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:50.433435 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-266da6fc-cf7a-40d0-a1d8-2ed8e7b93194 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:50.434959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-266da6fc-cf7a-40d0-a1d8-2ed8e7b93194 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:50.436199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-266da6fc-cf7a-40d0-a1d8-2ed8e7b93194 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.167988 Oct 04 08:52:50.436823 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 98/194] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:50 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:51.291877 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4a2b4c6a-c0c1-46be-98e2-b1994025cc36 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:51.292635 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4a2b4c6a-c0c1-46be-98e2-b1994025cc36 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:51.298919 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4a2b4c6a-c0c1-46be-98e2-b1994025cc36 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:51.299405 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4a2b4c6a-c0c1-46be-98e2-b1994025cc36 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:51.299802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4a2b4c6a-c0c1-46be-98e2-b1994025cc36 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:51.300526 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4a2b4c6a-c0c1-46be-98e2-b1994025cc36 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:51.300969 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4a2b4c6a-c0c1-46be-98e2-b1994025cc36 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:51.301385 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4a2b4c6a-c0c1-46be-98e2-b1994025cc36 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:51.435157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4a2b4c6a-c0c1-46be-98e2-b1994025cc36 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:51.442814 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4a2b4c6a-c0c1-46be-98e2-b1994025cc36 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.154838 Oct 04 08:52:51.443369 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 99/195] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:51 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:51.461297 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-cfd323fd-2b75-4bf0-be64-dc410993f2e3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:51.461922 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cfd323fd-2b75-4bf0-be64-dc410993f2e3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:51.467740 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cfd323fd-2b75-4bf0-be64-dc410993f2e3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:51.468256 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cfd323fd-2b75-4bf0-be64-dc410993f2e3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:51.468683 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cfd323fd-2b75-4bf0-be64-dc410993f2e3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:51.469363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cfd323fd-2b75-4bf0-be64-dc410993f2e3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:51.469799 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cfd323fd-2b75-4bf0-be64-dc410993f2e3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:51.470560 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cfd323fd-2b75-4bf0-be64-dc410993f2e3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:51.474142 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=100 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:51.602675 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cfd323fd-2b75-4bf0-be64-dc410993f2e3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:51.612955 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cfd323fd-2b75-4bf0-be64-dc410993f2e3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:51.614505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cfd323fd-2b75-4bf0-be64-dc410993f2e3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:51.615746 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-cfd323fd-2b75-4bf0-be64-dc410993f2e3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.158247 Oct 04 08:52:51.627912 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 100/196] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:51 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:52:52.466181 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b959a00e-70f1-4df5-8681-03f6d1ab65d4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:52.466785 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b959a00e-70f1-4df5-8681-03f6d1ab65d4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:52.472825 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b959a00e-70f1-4df5-8681-03f6d1ab65d4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:52.473305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b959a00e-70f1-4df5-8681-03f6d1ab65d4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:52.473740 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b959a00e-70f1-4df5-8681-03f6d1ab65d4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:52.474430 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b959a00e-70f1-4df5-8681-03f6d1ab65d4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:52.474877 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b959a00e-70f1-4df5-8681-03f6d1ab65d4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:52.475295 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b959a00e-70f1-4df5-8681-03f6d1ab65d4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:52.621394 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b959a00e-70f1-4df5-8681-03f6d1ab65d4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:52.629757 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b959a00e-70f1-4df5-8681-03f6d1ab65d4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.167701 Oct 04 08:52:52.630330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 101/197] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:52 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:52.640442 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5be97229-8bd7-4e19-acae-debaca61a6a8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:52.641033 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5be97229-8bd7-4e19-acae-debaca61a6a8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:52.647174 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5be97229-8bd7-4e19-acae-debaca61a6a8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:52.647637 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5be97229-8bd7-4e19-acae-debaca61a6a8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:52.648066 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5be97229-8bd7-4e19-acae-debaca61a6a8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:52.648738 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5be97229-8bd7-4e19-acae-debaca61a6a8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:52.649177 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5be97229-8bd7-4e19-acae-debaca61a6a8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:52.653943 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5be97229-8bd7-4e19-acae-debaca61a6a8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:52.782219 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5be97229-8bd7-4e19-acae-debaca61a6a8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:52.793712 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5be97229-8bd7-4e19-acae-debaca61a6a8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:52.795127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5be97229-8bd7-4e19-acae-debaca61a6a8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:52.796212 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5be97229-8bd7-4e19-acae-debaca61a6a8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.159454 Oct 04 08:52:52.796782 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 102/198] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:52 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:53.659039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-16bb3262-3eb4-418d-bb8e-58bd7d662ae0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:53.660230 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-16bb3262-3eb4-418d-bb8e-58bd7d662ae0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:53.669462 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16bb3262-3eb4-418d-bb8e-58bd7d662ae0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:53.669945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16bb3262-3eb4-418d-bb8e-58bd7d662ae0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:53.670366 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16bb3262-3eb4-418d-bb8e-58bd7d662ae0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:53.671095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16bb3262-3eb4-418d-bb8e-58bd7d662ae0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:53.671547 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16bb3262-3eb4-418d-bb8e-58bd7d662ae0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:53.671904 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16bb3262-3eb4-418d-bb8e-58bd7d662ae0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:53.808894 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-16bb3262-3eb4-418d-bb8e-58bd7d662ae0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:53.817350 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-16bb3262-3eb4-418d-bb8e-58bd7d662ae0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.166489 Oct 04 08:52:53.818058 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 103/199] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:53 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:53.832124 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c1d702ad-c836-4d38-9f57-8d7bb7db1f6e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:53.832802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c1d702ad-c836-4d38-9f57-8d7bb7db1f6e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:53.841851 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c1d702ad-c836-4d38-9f57-8d7bb7db1f6e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:53.842367 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c1d702ad-c836-4d38-9f57-8d7bb7db1f6e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:53.842973 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c1d702ad-c836-4d38-9f57-8d7bb7db1f6e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:53.843758 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c1d702ad-c836-4d38-9f57-8d7bb7db1f6e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:53.844289 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c1d702ad-c836-4d38-9f57-8d7bb7db1f6e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:53.844793 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c1d702ad-c836-4d38-9f57-8d7bb7db1f6e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:53.974211 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c1d702ad-c836-4d38-9f57-8d7bb7db1f6e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:53.982720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c1d702ad-c836-4d38-9f57-8d7bb7db1f6e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:53.984202 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c1d702ad-c836-4d38-9f57-8d7bb7db1f6e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:53.985294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c1d702ad-c836-4d38-9f57-8d7bb7db1f6e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.166314 Oct 04 08:52:53.985821 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 104/200] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:53 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:54.840486 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d0dd70e8-1ac5-49fe-98b0-6a72594d924d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:54.841056 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d0dd70e8-1ac5-49fe-98b0-6a72594d924d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:54.847917 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0dd70e8-1ac5-49fe-98b0-6a72594d924d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:54.848414 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0dd70e8-1ac5-49fe-98b0-6a72594d924d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:54.848836 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0dd70e8-1ac5-49fe-98b0-6a72594d924d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:54.849504 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0dd70e8-1ac5-49fe-98b0-6a72594d924d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:54.849944 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0dd70e8-1ac5-49fe-98b0-6a72594d924d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:54.850358 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0dd70e8-1ac5-49fe-98b0-6a72594d924d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:54.987404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d0dd70e8-1ac5-49fe-98b0-6a72594d924d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:54.995013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d0dd70e8-1ac5-49fe-98b0-6a72594d924d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1322 microversion: 2.1 time: 0.158596 Oct 04 08:52:54.995618 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 105/201] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:54 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:55.014417 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6da79afc-d5cb-431e-8173-feeb06dd6670 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:55.015149 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6da79afc-d5cb-431e-8173-feeb06dd6670 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:55.023527 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6da79afc-d5cb-431e-8173-feeb06dd6670 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:55.024277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6da79afc-d5cb-431e-8173-feeb06dd6670 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:55.024860 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6da79afc-d5cb-431e-8173-feeb06dd6670 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:55.025744 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6da79afc-d5cb-431e-8173-feeb06dd6670 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:55.026258 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6da79afc-d5cb-431e-8173-feeb06dd6670 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:55.026806 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6da79afc-d5cb-431e-8173-feeb06dd6670 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:55.161473 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6da79afc-d5cb-431e-8173-feeb06dd6670 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:55.171048 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6da79afc-d5cb-431e-8173-feeb06dd6670 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:55.185382 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6da79afc-d5cb-431e-8173-feeb06dd6670 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:55.186524 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6da79afc-d5cb-431e-8173-feeb06dd6670 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.176042 Oct 04 08:52:55.192202 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 106/202] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:55 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:52:56.023167 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ac0095ad-a3f9-4ed6-9fb9-5b371d85faac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:56.024217 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ac0095ad-a3f9-4ed6-9fb9-5b371d85faac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:56.031590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac0095ad-a3f9-4ed6-9fb9-5b371d85faac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:56.032110 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac0095ad-a3f9-4ed6-9fb9-5b371d85faac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:56.032548 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac0095ad-a3f9-4ed6-9fb9-5b371d85faac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:56.033227 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac0095ad-a3f9-4ed6-9fb9-5b371d85faac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:56.033673 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac0095ad-a3f9-4ed6-9fb9-5b371d85faac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:56.034087 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac0095ad-a3f9-4ed6-9fb9-5b371d85faac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:56.172168 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ac0095ad-a3f9-4ed6-9fb9-5b371d85faac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:56.179927 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ac0095ad-a3f9-4ed6-9fb9-5b371d85faac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1515 microversion: 2.1 time: 0.163282 Oct 04 08:52:56.180495 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 107/203] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:56 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:56.204298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-10922a63-d384-4f01-abdf-98abedce0bd2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:56.206807 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-10922a63-d384-4f01-abdf-98abedce0bd2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:56.212801 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10922a63-d384-4f01-abdf-98abedce0bd2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:56.213274 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10922a63-d384-4f01-abdf-98abedce0bd2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:56.213668 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10922a63-d384-4f01-abdf-98abedce0bd2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:56.214419 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10922a63-d384-4f01-abdf-98abedce0bd2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:56.214860 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10922a63-d384-4f01-abdf-98abedce0bd2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:56.215281 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10922a63-d384-4f01-abdf-98abedce0bd2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:56.274687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-10922a63-d384-4f01-abdf-98abedce0bd2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lazy-loading 'flavor' on Instance uuid 69e21016-5037-4bd1-91c6-97ab1b413e06 {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:52:56.396957 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-10922a63-d384-4f01-abdf-98abedce0bd2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "POST /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06/action" status: 200 len: 32 microversion: 2.1 time: 0.198272 Oct 04 08:52:56.397539 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 108/204] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Oct 4 08:52:56 2022] POST /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:52:56.402493 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-40d37203-0abc-442c-89d9-2e5cf6f8dfb5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:56.403169 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-40d37203-0abc-442c-89d9-2e5cf6f8dfb5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:56.409110 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-40d37203-0abc-442c-89d9-2e5cf6f8dfb5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:56.409578 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-40d37203-0abc-442c-89d9-2e5cf6f8dfb5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:56.409998 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-40d37203-0abc-442c-89d9-2e5cf6f8dfb5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:56.410664 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-40d37203-0abc-442c-89d9-2e5cf6f8dfb5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:56.411101 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-40d37203-0abc-442c-89d9-2e5cf6f8dfb5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:56.411509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-40d37203-0abc-442c-89d9-2e5cf6f8dfb5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:56.548324 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-40d37203-0abc-442c-89d9-2e5cf6f8dfb5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:56.560420 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-40d37203-0abc-442c-89d9-2e5cf6f8dfb5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:56.562831 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-40d37203-0abc-442c-89d9-2e5cf6f8dfb5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:56.564652 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-40d37203-0abc-442c-89d9-2e5cf6f8dfb5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.165845 Oct 04 08:52:56.565224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 109/205] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:56 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:56.570040 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-fb83c386-c31e-4a5d-9abf-8635b96e2dc7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:56.570786 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-fb83c386-c31e-4a5d-9abf-8635b96e2dc7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:56.577577 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fb83c386-c31e-4a5d-9abf-8635b96e2dc7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:56.578049 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fb83c386-c31e-4a5d-9abf-8635b96e2dc7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:56.578474 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fb83c386-c31e-4a5d-9abf-8635b96e2dc7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:56.579154 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fb83c386-c31e-4a5d-9abf-8635b96e2dc7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:56.579598 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fb83c386-c31e-4a5d-9abf-8635b96e2dc7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:56.580054 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fb83c386-c31e-4a5d-9abf-8635b96e2dc7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:56.708824 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-fb83c386-c31e-4a5d-9abf-8635b96e2dc7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:56.716862 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-fb83c386-c31e-4a5d-9abf-8635b96e2dc7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.150711 Oct 04 08:52:56.717429 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 110/206] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:56 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:57.591517 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4094702d-56be-4f0e-95e7-713a04f45748 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:57.592541 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4094702d-56be-4f0e-95e7-713a04f45748 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:57.602696 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4094702d-56be-4f0e-95e7-713a04f45748 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:57.603190 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4094702d-56be-4f0e-95e7-713a04f45748 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:57.603646 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4094702d-56be-4f0e-95e7-713a04f45748 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:57.604430 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4094702d-56be-4f0e-95e7-713a04f45748 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:57.605207 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4094702d-56be-4f0e-95e7-713a04f45748 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:57.605304 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4094702d-56be-4f0e-95e7-713a04f45748 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:57.744182 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4094702d-56be-4f0e-95e7-713a04f45748 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:57.752989 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4094702d-56be-4f0e-95e7-713a04f45748 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:57.754426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4094702d-56be-4f0e-95e7-713a04f45748 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:57.755525 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4094702d-56be-4f0e-95e7-713a04f45748 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.169136 Oct 04 08:52:57.756129 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 111/207] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:57 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:57.760471 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-910ab396-9cb0-4a7b-861f-987b41eab1b4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:57.761033 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-910ab396-9cb0-4a7b-861f-987b41eab1b4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:57.766624 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-910ab396-9cb0-4a7b-861f-987b41eab1b4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:57.767095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-910ab396-9cb0-4a7b-861f-987b41eab1b4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:57.767501 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-910ab396-9cb0-4a7b-861f-987b41eab1b4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:57.768252 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-910ab396-9cb0-4a7b-861f-987b41eab1b4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:57.768699 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-910ab396-9cb0-4a7b-861f-987b41eab1b4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:57.769120 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-910ab396-9cb0-4a7b-861f-987b41eab1b4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:57.902608 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-910ab396-9cb0-4a7b-861f-987b41eab1b4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:57.910644 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-910ab396-9cb0-4a7b-861f-987b41eab1b4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.153592 Oct 04 08:52:57.911211 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 112/208] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:57 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:58.704045 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=11 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:58.780566 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-cb5a7c6b-d35b-4c6e-bf71-716fb7484aa7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:58.781163 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cb5a7c6b-d35b-4c6e-bf71-716fb7484aa7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:58.787362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb5a7c6b-d35b-4c6e-bf71-716fb7484aa7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:58.787836 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb5a7c6b-d35b-4c6e-bf71-716fb7484aa7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:58.788322 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb5a7c6b-d35b-4c6e-bf71-716fb7484aa7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:58.789017 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb5a7c6b-d35b-4c6e-bf71-716fb7484aa7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:58.789440 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb5a7c6b-d35b-4c6e-bf71-716fb7484aa7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:58.789834 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb5a7c6b-d35b-4c6e-bf71-716fb7484aa7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:58.832455 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:58.919018 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cb5a7c6b-d35b-4c6e-bf71-716fb7484aa7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:58.927450 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cb5a7c6b-d35b-4c6e-bf71-716fb7484aa7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:58.928869 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cb5a7c6b-d35b-4c6e-bf71-716fb7484aa7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:58.929961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-cb5a7c6b-d35b-4c6e-bf71-716fb7484aa7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.153420 Oct 04 08:52:58.930515 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 113/209] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:58 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:58.934804 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-48edf228-f509-4dd1-a02f-7ea02545ec66 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:58.935396 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-48edf228-f509-4dd1-a02f-7ea02545ec66 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:58.942193 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-48edf228-f509-4dd1-a02f-7ea02545ec66 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:58.942663 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-48edf228-f509-4dd1-a02f-7ea02545ec66 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:58.943089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-48edf228-f509-4dd1-a02f-7ea02545ec66 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:58.943769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-48edf228-f509-4dd1-a02f-7ea02545ec66 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:58.944437 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-48edf228-f509-4dd1-a02f-7ea02545ec66 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:58.945051 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-48edf228-f509-4dd1-a02f-7ea02545ec66 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:59.078627 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-48edf228-f509-4dd1-a02f-7ea02545ec66 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:59.082121 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:59.087048 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-48edf228-f509-4dd1-a02f-7ea02545ec66 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.155594 Oct 04 08:52:59.087599 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 114/210] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:58 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:59.956636 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e36a8a5f-5e3e-417c-af0a-8baea546de16 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:59.957245 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e36a8a5f-5e3e-417c-af0a-8baea546de16 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:59.964151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e36a8a5f-5e3e-417c-af0a-8baea546de16 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:59.964571 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e36a8a5f-5e3e-417c-af0a-8baea546de16 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:59.965055 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e36a8a5f-5e3e-417c-af0a-8baea546de16 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:59.965749 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e36a8a5f-5e3e-417c-af0a-8baea546de16 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:59.966195 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e36a8a5f-5e3e-417c-af0a-8baea546de16 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:59.966624 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e36a8a5f-5e3e-417c-af0a-8baea546de16 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:00.100455 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e36a8a5f-5e3e-417c-af0a-8baea546de16 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:00.113364 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e36a8a5f-5e3e-417c-af0a-8baea546de16 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:00.114866 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e36a8a5f-5e3e-417c-af0a-8baea546de16 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:00.116013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e36a8a5f-5e3e-417c-af0a-8baea546de16 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.163419 Oct 04 08:53:00.116570 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 115/211] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:59 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:53:00.121232 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9248bd59-2984-4f02-9db0-52cb58e0a9df tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:00.121843 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9248bd59-2984-4f02-9db0-52cb58e0a9df tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:00.128077 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9248bd59-2984-4f02-9db0-52cb58e0a9df tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:00.128552 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9248bd59-2984-4f02-9db0-52cb58e0a9df tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:00.128965 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9248bd59-2984-4f02-9db0-52cb58e0a9df tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:00.129640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9248bd59-2984-4f02-9db0-52cb58e0a9df tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:00.130083 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9248bd59-2984-4f02-9db0-52cb58e0a9df tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:00.130494 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9248bd59-2984-4f02-9db0-52cb58e0a9df tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:00.264040 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9248bd59-2984-4f02-9db0-52cb58e0a9df tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:00.271788 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-9248bd59-2984-4f02-9db0-52cb58e0a9df tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.154280 Oct 04 08:53:00.272355 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 116/212] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:00 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:01.144054 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ddda007d-8127-43c9-8542-d4bb95579054 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:01.145206 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ddda007d-8127-43c9-8542-d4bb95579054 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:01.153177 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ddda007d-8127-43c9-8542-d4bb95579054 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:01.153853 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ddda007d-8127-43c9-8542-d4bb95579054 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:01.154355 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ddda007d-8127-43c9-8542-d4bb95579054 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:01.155873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ddda007d-8127-43c9-8542-d4bb95579054 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:01.156698 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ddda007d-8127-43c9-8542-d4bb95579054 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:01.157255 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ddda007d-8127-43c9-8542-d4bb95579054 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:01.234352 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fe4a9955-9224-4e0e-ab94-ac471a54aadd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "POST /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.541281 Oct 04 08:53:01.241117 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 97/213] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Oct 4 08:52:48 2022] POST /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642/os-volume_attachments => generated 194 bytes in 12543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:01.241117 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-562cb774-4e8f-4b37-8357-8b829dce5cfb req-6a1e5ab4-e7fe-471b-80a4-f108f4be7ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4454abc-67a9-470b-bdce-5a69bc51bbed", "name": "network-vif-plugged", "status": "completed", "tag": "a52bd48f-906c-4b87-b387-01e1bfaa69c2"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:01.257338 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-562cb774-4e8f-4b37-8357-8b829dce5cfb req-6a1e5ab4-e7fe-471b-80a4-f108f4be7ad3 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:01.257831 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-562cb774-4e8f-4b37-8357-8b829dce5cfb req-6a1e5ab4-e7fe-471b-80a4-f108f4be7ad3 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:01.258260 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-562cb774-4e8f-4b37-8357-8b829dce5cfb req-6a1e5ab4-e7fe-471b-80a4-f108f4be7ad3 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:01.269707 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-562cb774-4e8f-4b37-8357-8b829dce5cfb req-6a1e5ab4-e7fe-471b-80a4-f108f4be7ad3 service nova] Creating event network-vif-plugged:a52bd48f-906c-4b87-b387-01e1bfaa69c2 for instance f4454abc-67a9-470b-bdce-5a69bc51bbed on hv-cinder-84456 Oct 04 08:53:01.278177 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-562cb774-4e8f-4b37-8357-8b829dce5cfb req-6a1e5ab4-e7fe-471b-80a4-f108f4be7ad3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041833 Oct 04 08:53:01.283123 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 98/214] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:01.295340 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6682a9be-08fe-4139-9a70-9cbf00598064 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:01.297813 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6682a9be-08fe-4139-9a70-9cbf00598064 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:01.326021 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6682a9be-08fe-4139-9a70-9cbf00598064 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:01.326591 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6682a9be-08fe-4139-9a70-9cbf00598064 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:01.327034 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6682a9be-08fe-4139-9a70-9cbf00598064 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:01.327955 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6682a9be-08fe-4139-9a70-9cbf00598064 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:01.328571 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6682a9be-08fe-4139-9a70-9cbf00598064 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:01.328976 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6682a9be-08fe-4139-9a70-9cbf00598064 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:01.355005 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ddda007d-8127-43c9-8542-d4bb95579054 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:01.364204 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ddda007d-8127-43c9-8542-d4bb95579054 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:01.366186 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ddda007d-8127-43c9-8542-d4bb95579054 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:01.367559 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ddda007d-8127-43c9-8542-d4bb95579054 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.229391 Oct 04 08:53:01.380566 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 117/215] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:53:01 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:53:01.492022 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6682a9be-08fe-4139-9a70-9cbf00598064 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:01.508307 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6682a9be-08fe-4139-9a70-9cbf00598064 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.217134 Oct 04 08:53:01.524196 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 99/216] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:01 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:02.393703 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d5b7d208-33b1-42ac-841a-8f7866bd9672 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:02.394411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d5b7d208-33b1-42ac-841a-8f7866bd9672 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:02.400392 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5b7d208-33b1-42ac-841a-8f7866bd9672 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:02.400870 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5b7d208-33b1-42ac-841a-8f7866bd9672 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:02.401265 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5b7d208-33b1-42ac-841a-8f7866bd9672 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:02.401935 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5b7d208-33b1-42ac-841a-8f7866bd9672 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:02.402380 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5b7d208-33b1-42ac-841a-8f7866bd9672 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:02.402789 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5b7d208-33b1-42ac-841a-8f7866bd9672 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:02.530260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d5b7d208-33b1-42ac-841a-8f7866bd9672 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:02.531323 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-32308271-3032-4684-970d-82e1afc0a87a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:02.532018 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-32308271-3032-4684-970d-82e1afc0a87a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:02.538586 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d5b7d208-33b1-42ac-841a-8f7866bd9672 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:02.538769 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32308271-3032-4684-970d-82e1afc0a87a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:02.539204 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32308271-3032-4684-970d-82e1afc0a87a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:02.539663 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32308271-3032-4684-970d-82e1afc0a87a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:02.540070 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d5b7d208-33b1-42ac-841a-8f7866bd9672 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:02.540381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32308271-3032-4684-970d-82e1afc0a87a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:02.540827 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32308271-3032-4684-970d-82e1afc0a87a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:02.541159 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d5b7d208-33b1-42ac-841a-8f7866bd9672 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.151508 Oct 04 08:53:02.541314 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32308271-3032-4684-970d-82e1afc0a87a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:02.541714 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 118/217] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:53:02 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:53:02.682300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-32308271-3032-4684-970d-82e1afc0a87a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:02.693046 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-32308271-3032-4684-970d-82e1afc0a87a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.165435 Oct 04 08:53:02.693633 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 100/218] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:02 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:03.566370 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c90b0c6a-2cf2-4e74-909f-a8f155508e96 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:03.567017 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c90b0c6a-2cf2-4e74-909f-a8f155508e96 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:03.573083 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c90b0c6a-2cf2-4e74-909f-a8f155508e96 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:03.573562 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c90b0c6a-2cf2-4e74-909f-a8f155508e96 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:03.573991 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c90b0c6a-2cf2-4e74-909f-a8f155508e96 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:03.574671 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c90b0c6a-2cf2-4e74-909f-a8f155508e96 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:03.575115 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c90b0c6a-2cf2-4e74-909f-a8f155508e96 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:03.575552 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c90b0c6a-2cf2-4e74-909f-a8f155508e96 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:03.711061 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c90b0c6a-2cf2-4e74-909f-a8f155508e96 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:03.716962 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-10c8d924-09a9-48ba-9cde-8310617eebc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:03.717663 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-10c8d924-09a9-48ba-9cde-8310617eebc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:03.721444 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c90b0c6a-2cf2-4e74-909f-a8f155508e96 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:03.723354 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c90b0c6a-2cf2-4e74-909f-a8f155508e96 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:03.724529 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10c8d924-09a9-48ba-9cde-8310617eebc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:03.724704 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c90b0c6a-2cf2-4e74-909f-a8f155508e96 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1407 microversion: 2.20 time: 0.162311 Oct 04 08:53:03.725009 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10c8d924-09a9-48ba-9cde-8310617eebc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:03.725435 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10c8d924-09a9-48ba-9cde-8310617eebc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:03.725566 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 119/219] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:53:03 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:53:03.726378 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10c8d924-09a9-48ba-9cde-8310617eebc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:03.726886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10c8d924-09a9-48ba-9cde-8310617eebc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:03.727304 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10c8d924-09a9-48ba-9cde-8310617eebc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:03.861799 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-10c8d924-09a9-48ba-9cde-8310617eebc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:03.870204 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-10c8d924-09a9-48ba-9cde-8310617eebc5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.157496 Oct 04 08:53:03.870787 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 101/220] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:03 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:04.749901 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-08b985b8-ef85-4bcc-ac5d-8a2844f5ddc2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:04.751183 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-08b985b8-ef85-4bcc-ac5d-8a2844f5ddc2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:04.759969 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08b985b8-ef85-4bcc-ac5d-8a2844f5ddc2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:04.760629 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08b985b8-ef85-4bcc-ac5d-8a2844f5ddc2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:04.761307 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08b985b8-ef85-4bcc-ac5d-8a2844f5ddc2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:04.762176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08b985b8-ef85-4bcc-ac5d-8a2844f5ddc2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:04.763303 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08b985b8-ef85-4bcc-ac5d-8a2844f5ddc2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:04.764608 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08b985b8-ef85-4bcc-ac5d-8a2844f5ddc2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:04.893416 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8ad27dfc-8435-400c-a16f-4f4dbffe14ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:04.894181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8ad27dfc-8435-400c-a16f-4f4dbffe14ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:04.901397 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8ad27dfc-8435-400c-a16f-4f4dbffe14ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:04.902006 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8ad27dfc-8435-400c-a16f-4f4dbffe14ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:04.902496 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8ad27dfc-8435-400c-a16f-4f4dbffe14ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:04.903245 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8ad27dfc-8435-400c-a16f-4f4dbffe14ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:04.903802 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8ad27dfc-8435-400c-a16f-4f4dbffe14ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:04.904345 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8ad27dfc-8435-400c-a16f-4f4dbffe14ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:05.027407 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-08b985b8-ef85-4bcc-ac5d-8a2844f5ddc2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:05.040425 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-08b985b8-ef85-4bcc-ac5d-8a2844f5ddc2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:05.042761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-08b985b8-ef85-4bcc-ac5d-8a2844f5ddc2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:05.044405 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-08b985b8-ef85-4bcc-ac5d-8a2844f5ddc2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1598 microversion: 2.20 time: 0.298603 Oct 04 08:53:05.067075 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 120/221] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:53:04 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1598 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:53:05.077578 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b9165759-09e9-4f6a-9395-b253f4ee6e83 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:05.078216 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b9165759-09e9-4f6a-9395-b253f4ee6e83 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:05.089523 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9165759-09e9-4f6a-9395-b253f4ee6e83 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:05.090212 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9165759-09e9-4f6a-9395-b253f4ee6e83 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:05.090849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9165759-09e9-4f6a-9395-b253f4ee6e83 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:05.091750 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9165759-09e9-4f6a-9395-b253f4ee6e83 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:05.092413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9165759-09e9-4f6a-9395-b253f4ee6e83 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:05.093009 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9165759-09e9-4f6a-9395-b253f4ee6e83 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:05.105361 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8ad27dfc-8435-400c-a16f-4f4dbffe14ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:05.119703 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8ad27dfc-8435-400c-a16f-4f4dbffe14ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.230122 Oct 04 08:53:05.124078 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 102/222] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:04 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:05.191499 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b9165759-09e9-4f6a-9395-b253f4ee6e83 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.122740 Oct 04 08:53:05.200482 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 121/223] 10.222.0.44 () {60 vars in 1316 bytes} [Tue Oct 4 08:53:05 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:53:06.145112 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-92a25cdd-651b-4cdc-bfa7-5a122d1b24e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:06.146775 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-92a25cdd-651b-4cdc-bfa7-5a122d1b24e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:06.153310 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-92a25cdd-651b-4cdc-bfa7-5a122d1b24e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:06.153868 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-92a25cdd-651b-4cdc-bfa7-5a122d1b24e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:06.154286 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-92a25cdd-651b-4cdc-bfa7-5a122d1b24e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:06.154973 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-92a25cdd-651b-4cdc-bfa7-5a122d1b24e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:06.155416 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-92a25cdd-651b-4cdc-bfa7-5a122d1b24e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:06.155828 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-92a25cdd-651b-4cdc-bfa7-5a122d1b24e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:06.406543 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-92a25cdd-651b-4cdc-bfa7-5a122d1b24e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:06.415139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-92a25cdd-651b-4cdc-bfa7-5a122d1b24e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.276343 Oct 04 08:53:06.415733 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 103/224] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:06 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:06.686742 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-2c7c4366-2cf9-4a41-a905-9e3d715f3998 req-a0d1c617-6472-430e-8ceb-dec6fdc62d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4454abc-67a9-470b-bdce-5a69bc51bbed", "tag": "a52bd48f-906c-4b87-b387-01e1bfaa69c2"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:06.709199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-2c7c4366-2cf9-4a41-a905-9e3d715f3998 req-a0d1c617-6472-430e-8ceb-dec6fdc62d89 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:06.709763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-2c7c4366-2cf9-4a41-a905-9e3d715f3998 req-a0d1c617-6472-430e-8ceb-dec6fdc62d89 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:06.710310 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-2c7c4366-2cf9-4a41-a905-9e3d715f3998 req-a0d1c617-6472-430e-8ceb-dec6fdc62d89 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:06.722858 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-2c7c4366-2cf9-4a41-a905-9e3d715f3998 req-a0d1c617-6472-430e-8ceb-dec6fdc62d89 service nova] Creating event network-changed:a52bd48f-906c-4b87-b387-01e1bfaa69c2 for instance f4454abc-67a9-470b-bdce-5a69bc51bbed on hv-cinder-84456 Oct 04 08:53:06.729001 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-2c7c4366-2cf9-4a41-a905-9e3d715f3998 req-a0d1c617-6472-430e-8ceb-dec6fdc62d89 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046291 Oct 04 08:53:06.730476 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 122/225] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:07.442473 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c88b7c5c-4b43-4e4c-acd4-3418eb42805c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:07.443180 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c88b7c5c-4b43-4e4c-acd4-3418eb42805c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:07.450923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c88b7c5c-4b43-4e4c-acd4-3418eb42805c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:07.451953 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c88b7c5c-4b43-4e4c-acd4-3418eb42805c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:07.452605 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c88b7c5c-4b43-4e4c-acd4-3418eb42805c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:07.453753 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c88b7c5c-4b43-4e4c-acd4-3418eb42805c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:07.454459 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c88b7c5c-4b43-4e4c-acd4-3418eb42805c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:07.455092 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c88b7c5c-4b43-4e4c-acd4-3418eb42805c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:07.613778 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c88b7c5c-4b43-4e4c-acd4-3418eb42805c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:07.622119 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c88b7c5c-4b43-4e4c-acd4-3418eb42805c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.184147 Oct 04 08:53:07.623045 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 104/226] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:07 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:08.647010 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7523d0a6-2d48-4ab3-876a-5f8cfa1c0a29 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:08.647832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7523d0a6-2d48-4ab3-876a-5f8cfa1c0a29 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:08.655168 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7523d0a6-2d48-4ab3-876a-5f8cfa1c0a29 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:08.655651 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7523d0a6-2d48-4ab3-876a-5f8cfa1c0a29 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:08.656109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7523d0a6-2d48-4ab3-876a-5f8cfa1c0a29 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:08.656791 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7523d0a6-2d48-4ab3-876a-5f8cfa1c0a29 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:08.657238 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7523d0a6-2d48-4ab3-876a-5f8cfa1c0a29 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:08.657656 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7523d0a6-2d48-4ab3-876a-5f8cfa1c0a29 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:08.819019 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7523d0a6-2d48-4ab3-876a-5f8cfa1c0a29 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:08.827137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7523d0a6-2d48-4ab3-876a-5f8cfa1c0a29 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.184681 Oct 04 08:53:08.827742 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 123/227] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:08 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:09.850540 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6cdb4844-9f01-40c0-b25e-3463324d1dac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:09.851142 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6cdb4844-9f01-40c0-b25e-3463324d1dac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:09.857895 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6cdb4844-9f01-40c0-b25e-3463324d1dac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:09.858366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6cdb4844-9f01-40c0-b25e-3463324d1dac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:09.859079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6cdb4844-9f01-40c0-b25e-3463324d1dac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:09.859797 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6cdb4844-9f01-40c0-b25e-3463324d1dac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:09.860278 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6cdb4844-9f01-40c0-b25e-3463324d1dac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:09.860696 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6cdb4844-9f01-40c0-b25e-3463324d1dac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:10.052441 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6cdb4844-9f01-40c0-b25e-3463324d1dac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:10.061820 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6cdb4844-9f01-40c0-b25e-3463324d1dac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.215147 Oct 04 08:53:10.076534 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 105/228] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:09 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:11.085536 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a4192462-6849-4b13-8f08-091697cf3991 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:11.086114 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a4192462-6849-4b13-8f08-091697cf3991 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:11.092639 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4192462-6849-4b13-8f08-091697cf3991 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.093146 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4192462-6849-4b13-8f08-091697cf3991 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.093577 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4192462-6849-4b13-8f08-091697cf3991 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:11.094288 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4192462-6849-4b13-8f08-091697cf3991 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.094745 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4192462-6849-4b13-8f08-091697cf3991 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.095167 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4192462-6849-4b13-8f08-091697cf3991 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:11.238154 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-a4192462-6849-4b13-8f08-091697cf3991 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:11.249253 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a4192462-6849-4b13-8f08-091697cf3991 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.167612 Oct 04 08:53:11.249884 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 124/229] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:11 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:12.271361 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9dd6a229-bc48-48a3-9f83-43da73871f3b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:12.272025 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9dd6a229-bc48-48a3-9f83-43da73871f3b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:12.278565 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9dd6a229-bc48-48a3-9f83-43da73871f3b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:12.279081 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9dd6a229-bc48-48a3-9f83-43da73871f3b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:12.279513 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9dd6a229-bc48-48a3-9f83-43da73871f3b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:12.281644 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9dd6a229-bc48-48a3-9f83-43da73871f3b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:12.282131 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9dd6a229-bc48-48a3-9f83-43da73871f3b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:12.282789 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9dd6a229-bc48-48a3-9f83-43da73871f3b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:12.428827 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9dd6a229-bc48-48a3-9f83-43da73871f3b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:12.436602 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9dd6a229-bc48-48a3-9f83-43da73871f3b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.169010 Oct 04 08:53:12.437136 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 106/230] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:12 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:13.460320 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1d8c70e9-ac87-45b8-bf15-8e33af673883 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:13.460930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1d8c70e9-ac87-45b8-bf15-8e33af673883 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:13.463721 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=72 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:13.470171 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1d8c70e9-ac87-45b8-bf15-8e33af673883 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:13.470660 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1d8c70e9-ac87-45b8-bf15-8e33af673883 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:13.471094 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1d8c70e9-ac87-45b8-bf15-8e33af673883 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:13.471786 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1d8c70e9-ac87-45b8-bf15-8e33af673883 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:13.472268 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1d8c70e9-ac87-45b8-bf15-8e33af673883 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:13.472693 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1d8c70e9-ac87-45b8-bf15-8e33af673883 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:13.601621 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1d8c70e9-ac87-45b8-bf15-8e33af673883 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:13.609796 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1d8c70e9-ac87-45b8-bf15-8e33af673883 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.153713 Oct 04 08:53:13.610383 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 125/231] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:13 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:14.635248 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-63bb2ad9-0430-4e3c-be1d-8f7d38fa9fdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:14.636165 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-63bb2ad9-0430-4e3c-be1d-8f7d38fa9fdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:14.642937 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63bb2ad9-0430-4e3c-be1d-8f7d38fa9fdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:14.643510 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63bb2ad9-0430-4e3c-be1d-8f7d38fa9fdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:14.643858 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63bb2ad9-0430-4e3c-be1d-8f7d38fa9fdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:14.644570 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63bb2ad9-0430-4e3c-be1d-8f7d38fa9fdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:14.645023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63bb2ad9-0430-4e3c-be1d-8f7d38fa9fdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:14.645442 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63bb2ad9-0430-4e3c-be1d-8f7d38fa9fdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:14.779937 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-63bb2ad9-0430-4e3c-be1d-8f7d38fa9fdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:14.788635 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-63bb2ad9-0430-4e3c-be1d-8f7d38fa9fdf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.158627 Oct 04 08:53:14.789195 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 107/232] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:14 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:15.815526 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1e82ad10-1ae3-4e09-8dd7-ae5c328d21e8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:15.816408 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1e82ad10-1ae3-4e09-8dd7-ae5c328d21e8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:15.826845 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1e82ad10-1ae3-4e09-8dd7-ae5c328d21e8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:15.827531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1e82ad10-1ae3-4e09-8dd7-ae5c328d21e8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:15.828010 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1e82ad10-1ae3-4e09-8dd7-ae5c328d21e8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:15.828699 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1e82ad10-1ae3-4e09-8dd7-ae5c328d21e8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:15.829149 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1e82ad10-1ae3-4e09-8dd7-ae5c328d21e8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:15.829577 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1e82ad10-1ae3-4e09-8dd7-ae5c328d21e8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:15.956382 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1e82ad10-1ae3-4e09-8dd7-ae5c328d21e8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:15.964722 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1e82ad10-1ae3-4e09-8dd7-ae5c328d21e8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.155863 Oct 04 08:53:15.965308 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 126/233] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:15 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:16.987848 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2df4edb4-0445-42da-af48-bc6c471c1e75 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:16.988505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2df4edb4-0445-42da-af48-bc6c471c1e75 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:16.995361 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2df4edb4-0445-42da-af48-bc6c471c1e75 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:16.995843 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2df4edb4-0445-42da-af48-bc6c471c1e75 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:16.996385 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2df4edb4-0445-42da-af48-bc6c471c1e75 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:16.997074 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2df4edb4-0445-42da-af48-bc6c471c1e75 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:16.997519 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2df4edb4-0445-42da-af48-bc6c471c1e75 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:16.997936 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2df4edb4-0445-42da-af48-bc6c471c1e75 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:17.129574 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2df4edb4-0445-42da-af48-bc6c471c1e75 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:17.137343 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2df4edb4-0445-42da-af48-bc6c471c1e75 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.153817 Oct 04 08:53:17.137914 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 108/234] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:16 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:18.164533 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ffee1e42-dcd5-4037-aa65-dc22cfe21451 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:18.165337 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ffee1e42-dcd5-4037-aa65-dc22cfe21451 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:18.174287 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffee1e42-dcd5-4037-aa65-dc22cfe21451 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:18.174994 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffee1e42-dcd5-4037-aa65-dc22cfe21451 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:18.175432 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffee1e42-dcd5-4037-aa65-dc22cfe21451 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:18.176392 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffee1e42-dcd5-4037-aa65-dc22cfe21451 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:18.177007 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffee1e42-dcd5-4037-aa65-dc22cfe21451 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:18.177654 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffee1e42-dcd5-4037-aa65-dc22cfe21451 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:18.318631 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ffee1e42-dcd5-4037-aa65-dc22cfe21451 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:18.327926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ffee1e42-dcd5-4037-aa65-dc22cfe21451 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.168908 Oct 04 08:53:18.327926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 127/235] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:18 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:19.349162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1c6fbbcd-ee34-4937-bc7b-fcb4443f6d32 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:19.349584 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1c6fbbcd-ee34-4937-bc7b-fcb4443f6d32 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:19.355589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1c6fbbcd-ee34-4937-bc7b-fcb4443f6d32 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:19.356073 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1c6fbbcd-ee34-4937-bc7b-fcb4443f6d32 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:19.356508 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1c6fbbcd-ee34-4937-bc7b-fcb4443f6d32 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:19.357198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1c6fbbcd-ee34-4937-bc7b-fcb4443f6d32 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:19.357641 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1c6fbbcd-ee34-4937-bc7b-fcb4443f6d32 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:19.358057 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1c6fbbcd-ee34-4937-bc7b-fcb4443f6d32 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:19.484908 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1c6fbbcd-ee34-4937-bc7b-fcb4443f6d32 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:19.493915 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1c6fbbcd-ee34-4937-bc7b-fcb4443f6d32 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.148842 Oct 04 08:53:19.494508 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 109/236] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:19 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:20.516309 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9e793c6a-f864-4350-8346-d7a038ab9114 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:20.516954 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9e793c6a-f864-4350-8346-d7a038ab9114 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:20.523144 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9e793c6a-f864-4350-8346-d7a038ab9114 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:20.523626 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9e793c6a-f864-4350-8346-d7a038ab9114 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:20.524117 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9e793c6a-f864-4350-8346-d7a038ab9114 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:20.524803 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9e793c6a-f864-4350-8346-d7a038ab9114 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:20.525244 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9e793c6a-f864-4350-8346-d7a038ab9114 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:20.525668 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9e793c6a-f864-4350-8346-d7a038ab9114 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:20.674972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9e793c6a-f864-4350-8346-d7a038ab9114 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:20.683564 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-9e793c6a-f864-4350-8346-d7a038ab9114 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.171227 Oct 04 08:53:20.684160 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 128/237] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:20 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:20.708120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c43cfcd2-5688-4c7d-a0fa-c1c02e1f205c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:20.709139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c43cfcd2-5688-4c7d-a0fa-c1c02e1f205c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:20.715850 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c43cfcd2-5688-4c7d-a0fa-c1c02e1f205c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:20.716560 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c43cfcd2-5688-4c7d-a0fa-c1c02e1f205c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:20.716998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c43cfcd2-5688-4c7d-a0fa-c1c02e1f205c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:20.717699 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c43cfcd2-5688-4c7d-a0fa-c1c02e1f205c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:20.718148 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c43cfcd2-5688-4c7d-a0fa-c1c02e1f205c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:20.718565 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c43cfcd2-5688-4c7d-a0fa-c1c02e1f205c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:20.744263 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c43cfcd2-5688-4c7d-a0fa-c1c02e1f205c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Going to try to terminate instance {{(pid=142439) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:53:20.848194 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c43cfcd2-5688-4c7d-a0fa-c1c02e1f205c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 204 len: 0 microversion: 2.1 time: 0.143006 Oct 04 08:53:20.851264 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 110/238] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 08:53:20 2022] DELETE /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:53:20.856232 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-959201f6-f467-4e8f-999e-4a63f64297bd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:20.856843 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-959201f6-f467-4e8f-999e-4a63f64297bd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:20.862972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-959201f6-f467-4e8f-999e-4a63f64297bd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:20.863441 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-959201f6-f467-4e8f-999e-4a63f64297bd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:20.863864 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-959201f6-f467-4e8f-999e-4a63f64297bd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:20.864596 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-959201f6-f467-4e8f-999e-4a63f64297bd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:20.865035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-959201f6-f467-4e8f-999e-4a63f64297bd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:20.865504 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-959201f6-f467-4e8f-999e-4a63f64297bd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:20.999021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-959201f6-f467-4e8f-999e-4a63f64297bd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:21.007536 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-959201f6-f467-4e8f-999e-4a63f64297bd tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1553 microversion: 2.1 time: 0.155057 Oct 04 08:53:21.008136 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 129/239] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:20 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:21.711061 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-15daf903-fe57-4e7a-b150-007784ff74e9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:21.711994 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-15daf903-fe57-4e7a-b150-007784ff74e9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:21.721353 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-15daf903-fe57-4e7a-b150-007784ff74e9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:21.721837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-15daf903-fe57-4e7a-b150-007784ff74e9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:21.722259 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-15daf903-fe57-4e7a-b150-007784ff74e9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:21.722936 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-15daf903-fe57-4e7a-b150-007784ff74e9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:21.723388 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-15daf903-fe57-4e7a-b150-007784ff74e9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:21.723806 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-15daf903-fe57-4e7a-b150-007784ff74e9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:21.870471 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-15daf903-fe57-4e7a-b150-007784ff74e9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:21.881440 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-15daf903-fe57-4e7a-b150-007784ff74e9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.176874 Oct 04 08:53:21.882154 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 111/240] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:21 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:22.032260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-817437f8-f2f2-4a11-9990-d3c7af31664c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:22.032867 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-817437f8-f2f2-4a11-9990-d3c7af31664c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:22.039201 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-817437f8-f2f2-4a11-9990-d3c7af31664c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:22.039715 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-817437f8-f2f2-4a11-9990-d3c7af31664c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:22.040398 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-817437f8-f2f2-4a11-9990-d3c7af31664c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:22.041213 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-817437f8-f2f2-4a11-9990-d3c7af31664c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:22.041797 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-817437f8-f2f2-4a11-9990-d3c7af31664c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:22.042350 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-817437f8-f2f2-4a11-9990-d3c7af31664c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:22.186801 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-817437f8-f2f2-4a11-9990-d3c7af31664c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:22.195179 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-817437f8-f2f2-4a11-9990-d3c7af31664c tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1553 microversion: 2.1 time: 0.167021 Oct 04 08:53:22.195745 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 130/241] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:22 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:22.909656 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-3dddcffc-be51-4634-8887-edc3e0dc9cd8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:22.910213 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-3dddcffc-be51-4634-8887-edc3e0dc9cd8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:22.917090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3dddcffc-be51-4634-8887-edc3e0dc9cd8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:22.917572 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3dddcffc-be51-4634-8887-edc3e0dc9cd8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:22.917993 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3dddcffc-be51-4634-8887-edc3e0dc9cd8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:22.918677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3dddcffc-be51-4634-8887-edc3e0dc9cd8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:22.919123 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3dddcffc-be51-4634-8887-edc3e0dc9cd8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:22.919538 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3dddcffc-be51-4634-8887-edc3e0dc9cd8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:22.923620 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:23.049861 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-3dddcffc-be51-4634-8887-edc3e0dc9cd8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:23.062070 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-3dddcffc-be51-4634-8887-edc3e0dc9cd8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.157614 Oct 04 08:53:23.062850 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 112/242] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:22 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:23.222428 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-08daf18b-fd0c-4b0a-9636-c92e305d72ad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:23.223037 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-08daf18b-fd0c-4b0a-9636-c92e305d72ad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:23.229217 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08daf18b-fd0c-4b0a-9636-c92e305d72ad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:23.229703 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08daf18b-fd0c-4b0a-9636-c92e305d72ad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:23.230133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08daf18b-fd0c-4b0a-9636-c92e305d72ad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:23.230811 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08daf18b-fd0c-4b0a-9636-c92e305d72ad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:23.231289 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08daf18b-fd0c-4b0a-9636-c92e305d72ad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:23.231708 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08daf18b-fd0c-4b0a-9636-c92e305d72ad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:23.543520 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-08daf18b-fd0c-4b0a-9636-c92e305d72ad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:23.551718 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-08daf18b-fd0c-4b0a-9636-c92e305d72ad tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1553 microversion: 2.1 time: 0.334413 Oct 04 08:53:23.552302 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 131/243] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:23 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1553 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:24.086142 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f64e4129-a3bc-4fb4-b447-2dc7e0abad05 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:24.086897 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f64e4129-a3bc-4fb4-b447-2dc7e0abad05 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:24.094064 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f64e4129-a3bc-4fb4-b447-2dc7e0abad05 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:24.094605 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f64e4129-a3bc-4fb4-b447-2dc7e0abad05 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:24.095033 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f64e4129-a3bc-4fb4-b447-2dc7e0abad05 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:24.095723 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f64e4129-a3bc-4fb4-b447-2dc7e0abad05 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:24.096222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f64e4129-a3bc-4fb4-b447-2dc7e0abad05 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:24.096650 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f64e4129-a3bc-4fb4-b447-2dc7e0abad05 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:24.295784 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f64e4129-a3bc-4fb4-b447-2dc7e0abad05 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:24.317157 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f64e4129-a3bc-4fb4-b447-2dc7e0abad05 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.235334 Oct 04 08:53:24.317752 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 113/244] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:24 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:24.575543 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c573b172-5b68-4e06-b6fa-7dc69f7ccbcc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:24.576211 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c573b172-5b68-4e06-b6fa-7dc69f7ccbcc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:24.582940 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c573b172-5b68-4e06-b6fa-7dc69f7ccbcc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:24.583389 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c573b172-5b68-4e06-b6fa-7dc69f7ccbcc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:24.583860 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c573b172-5b68-4e06-b6fa-7dc69f7ccbcc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:24.584631 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c573b172-5b68-4e06-b6fa-7dc69f7ccbcc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:24.585225 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c573b172-5b68-4e06-b6fa-7dc69f7ccbcc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:24.585500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c573b172-5b68-4e06-b6fa-7dc69f7ccbcc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:24.604588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=100 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:24.725268 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c573b172-5b68-4e06-b6fa-7dc69f7ccbcc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:24.733507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c573b172-5b68-4e06-b6fa-7dc69f7ccbcc tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1553 microversion: 2.1 time: 0.162808 Oct 04 08:53:24.734109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 132/245] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:24 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:25.340571 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9544e474-e4d4-4702-a5e3-741a37fab0fd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:25.341541 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9544e474-e4d4-4702-a5e3-741a37fab0fd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:25.349139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9544e474-e4d4-4702-a5e3-741a37fab0fd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:25.349748 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9544e474-e4d4-4702-a5e3-741a37fab0fd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:25.350568 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9544e474-e4d4-4702-a5e3-741a37fab0fd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:25.351690 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9544e474-e4d4-4702-a5e3-741a37fab0fd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:25.352315 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9544e474-e4d4-4702-a5e3-741a37fab0fd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:25.353280 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9544e474-e4d4-4702-a5e3-741a37fab0fd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:25.492763 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9544e474-e4d4-4702-a5e3-741a37fab0fd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:25.500898 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9544e474-e4d4-4702-a5e3-741a37fab0fd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.164589 Oct 04 08:53:25.501467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 114/246] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:25 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:25.756893 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-421d2e1d-ea36-405f-94a7-e1785598eebf tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:25.757499 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-421d2e1d-ea36-405f-94a7-e1785598eebf tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:25.763424 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-421d2e1d-ea36-405f-94a7-e1785598eebf tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:25.763977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-421d2e1d-ea36-405f-94a7-e1785598eebf tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:25.764367 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-421d2e1d-ea36-405f-94a7-e1785598eebf tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:25.765054 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-421d2e1d-ea36-405f-94a7-e1785598eebf tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:25.765510 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-421d2e1d-ea36-405f-94a7-e1785598eebf tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:25.765927 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-421d2e1d-ea36-405f-94a7-e1785598eebf tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:25.894053 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-421d2e1d-ea36-405f-94a7-e1785598eebf tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:25.902374 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-421d2e1d-ea36-405f-94a7-e1785598eebf tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1553 microversion: 2.1 time: 0.149339 Oct 04 08:53:25.902952 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 133/247] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:25 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:26.524051 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b937a097-9310-4abd-acf4-5f2f5494c4c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:26.524831 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b937a097-9310-4abd-acf4-5f2f5494c4c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:26.531323 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b937a097-9310-4abd-acf4-5f2f5494c4c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:26.531807 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b937a097-9310-4abd-acf4-5f2f5494c4c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:26.532305 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b937a097-9310-4abd-acf4-5f2f5494c4c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:26.532997 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b937a097-9310-4abd-acf4-5f2f5494c4c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:26.533445 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b937a097-9310-4abd-acf4-5f2f5494c4c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:26.533861 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b937a097-9310-4abd-acf4-5f2f5494c4c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:26.668972 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b937a097-9310-4abd-acf4-5f2f5494c4c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:26.676692 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b937a097-9310-4abd-acf4-5f2f5494c4c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.156535 Oct 04 08:53:26.677281 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 115/248] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:26 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:26.926465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d0a9182f-9a94-440f-8315-109e64fefccb tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:26.927105 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d0a9182f-9a94-440f-8315-109e64fefccb tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:26.933906 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0a9182f-9a94-440f-8315-109e64fefccb tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:26.934389 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0a9182f-9a94-440f-8315-109e64fefccb tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:26.934811 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0a9182f-9a94-440f-8315-109e64fefccb tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:26.935508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0a9182f-9a94-440f-8315-109e64fefccb tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:26.935990 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0a9182f-9a94-440f-8315-109e64fefccb tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:26.939362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d0a9182f-9a94-440f-8315-109e64fefccb tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:27.088465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d0a9182f-9a94-440f-8315-109e64fefccb tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:27.097780 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d0a9182f-9a94-440f-8315-109e64fefccb tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1553 microversion: 2.1 time: 0.175890 Oct 04 08:53:27.099976 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 134/249] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:26 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:27.699650 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0a6e145c-6274-47cb-9fb8-3128bd4eeaf2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:27.702552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0a6e145c-6274-47cb-9fb8-3128bd4eeaf2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:27.711974 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a6e145c-6274-47cb-9fb8-3128bd4eeaf2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:27.712601 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a6e145c-6274-47cb-9fb8-3128bd4eeaf2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:27.713062 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a6e145c-6274-47cb-9fb8-3128bd4eeaf2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:27.714027 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a6e145c-6274-47cb-9fb8-3128bd4eeaf2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:27.714719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a6e145c-6274-47cb-9fb8-3128bd4eeaf2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:27.715304 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a6e145c-6274-47cb-9fb8-3128bd4eeaf2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:27.991631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0a6e145c-6274-47cb-9fb8-3128bd4eeaf2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:28.000258 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0a6e145c-6274-47cb-9fb8-3128bd4eeaf2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.304502 Oct 04 08:53:28.000842 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 116/250] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:27 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:28.122689 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-87462d38-7145-469a-842a-75ad2be0fa5a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:28.123356 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-87462d38-7145-469a-842a-75ad2be0fa5a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:28.131915 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-87462d38-7145-469a-842a-75ad2be0fa5a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:28.132687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-87462d38-7145-469a-842a-75ad2be0fa5a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:28.133560 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-87462d38-7145-469a-842a-75ad2be0fa5a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:28.134811 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-87462d38-7145-469a-842a-75ad2be0fa5a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:28.135417 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-87462d38-7145-469a-842a-75ad2be0fa5a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:28.136329 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-87462d38-7145-469a-842a-75ad2be0fa5a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:28.409423 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-87462d38-7145-469a-842a-75ad2be0fa5a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:28.419398 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-87462d38-7145-469a-842a-75ad2be0fa5a tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1553 microversion: 2.1 time: 0.301366 Oct 04 08:53:28.420213 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 135/251] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:28 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1553 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:28.746482 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-d7dcf97c-3ed7-45d8-a34a-4fddaad04fe8 req-0d43c707-1935-4700-9c90-9daff4f4e62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c263bad-2d03-4333-9fa9-89c8df65a642", "name": "network-vif-deleted", "tag": "df362683-126c-4695-a04d-36d66437dfc5"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:28.765845 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:28.768375 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-d7dcf97c-3ed7-45d8-a34a-4fddaad04fe8 req-0d43c707-1935-4700-9c90-9daff4f4e62c service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:28.770735 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-d7dcf97c-3ed7-45d8-a34a-4fddaad04fe8 req-0d43c707-1935-4700-9c90-9daff4f4e62c service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:28.771676 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-d7dcf97c-3ed7-45d8-a34a-4fddaad04fe8 req-0d43c707-1935-4700-9c90-9daff4f4e62c service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:28.812548 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-d7dcf97c-3ed7-45d8-a34a-4fddaad04fe8 req-0d43c707-1935-4700-9c90-9daff4f4e62c service nova] Creating event network-vif-deleted:df362683-126c-4695-a04d-36d66437dfc5 for instance 8c263bad-2d03-4333-9fa9-89c8df65a642 on hv-cinder-84456 Oct 04 08:53:28.828087 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-d7dcf97c-3ed7-45d8-a34a-4fddaad04fe8 req-0d43c707-1935-4700-9c90-9daff4f4e62c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089451 Oct 04 08:53:28.831499 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 117/252] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:53:29.023426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2567621b-9eec-41d3-bd21-6da8e0587ad1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:29.024514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2567621b-9eec-41d3-bd21-6da8e0587ad1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:29.031451 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2567621b-9eec-41d3-bd21-6da8e0587ad1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:29.031997 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2567621b-9eec-41d3-bd21-6da8e0587ad1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:29.032437 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2567621b-9eec-41d3-bd21-6da8e0587ad1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:29.033125 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2567621b-9eec-41d3-bd21-6da8e0587ad1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:29.033574 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2567621b-9eec-41d3-bd21-6da8e0587ad1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:29.033992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2567621b-9eec-41d3-bd21-6da8e0587ad1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:29.163223 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2567621b-9eec-41d3-bd21-6da8e0587ad1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:29.170941 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2567621b-9eec-41d3-bd21-6da8e0587ad1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.151622 Oct 04 08:53:29.171601 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 136/253] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:29 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:29.449685 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9de86316-1ee0-410e-af9b-ddc8928c248d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:29.450784 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9de86316-1ee0-410e-af9b-ddc8928c248d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:29.459761 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9de86316-1ee0-410e-af9b-ddc8928c248d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:29.460375 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9de86316-1ee0-410e-af9b-ddc8928c248d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:29.460872 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9de86316-1ee0-410e-af9b-ddc8928c248d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:29.461713 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9de86316-1ee0-410e-af9b-ddc8928c248d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:29.462510 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9de86316-1ee0-410e-af9b-ddc8928c248d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:29.463379 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9de86316-1ee0-410e-af9b-ddc8928c248d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:29.562535 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9de86316-1ee0-410e-af9b-ddc8928c248d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ccd41938954a36adb45c70e6ff41de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d8cf4a0b74162b6f73a0b2d88ff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:29.571325 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9de86316-1ee0-410e-af9b-ddc8928c248d tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 200 len: 1346 microversion: 2.1 time: 0.130489 Oct 04 08:53:29.571972 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 118/254] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:29 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 1346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:30.199060 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-21f37041-9e4b-4b13-9289-e290d7a1430a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:30.199607 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-21f37041-9e4b-4b13-9289-e290d7a1430a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:30.206122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-21f37041-9e4b-4b13-9289-e290d7a1430a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:30.206614 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-21f37041-9e4b-4b13-9289-e290d7a1430a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:30.207137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-21f37041-9e4b-4b13-9289-e290d7a1430a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:30.207829 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-21f37041-9e4b-4b13-9289-e290d7a1430a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:30.208323 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-21f37041-9e4b-4b13-9289-e290d7a1430a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:30.208741 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-21f37041-9e4b-4b13-9289-e290d7a1430a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:30.352749 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-21f37041-9e4b-4b13-9289-e290d7a1430a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:30.368201 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-21f37041-9e4b-4b13-9289-e290d7a1430a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.176126 Oct 04 08:53:30.372392 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 137/255] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:30 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:30.594204 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-43ab77bc-2e88-4e63-bb6a-6abeb635d5fe tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:30.594810 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-43ab77bc-2e88-4e63-bb6a-6abeb635d5fe tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:30.601141 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-43ab77bc-2e88-4e63-bb6a-6abeb635d5fe tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:30.601514 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-43ab77bc-2e88-4e63-bb6a-6abeb635d5fe tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:30.601943 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-43ab77bc-2e88-4e63-bb6a-6abeb635d5fe tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:30.602625 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-43ab77bc-2e88-4e63-bb6a-6abeb635d5fe tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:30.603073 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-43ab77bc-2e88-4e63-bb6a-6abeb635d5fe tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:30.603491 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-43ab77bc-2e88-4e63-bb6a-6abeb635d5fe tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:30.617408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-43ab77bc-2e88-4e63-bb6a-6abeb635d5fe tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] HTTP exception thrown: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-43ab77bc-2e88-4e63-bb6a-6abeb635d5fe tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Request method failure captured: Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 HTTP/1.1 Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_Qdr5ss2_bxs0WLBAVUMlkKcboh1ZxcgflTN8z_NzMbIGixIkOmq2gm2TYao8bfMssTtBX4loWY1yZNsoxGVvm8oRIjGLfyuCIeqy01jSLu3yh1p2QFl9l8ZiASfOsLCS2oHkFdOtQuoqrlNDnGEkLcX2pGX9Nch_ixRjSgq7IApdU Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 0c4d8cf4a0b74162b6f73a0b2d88ff09 Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-DeleteServersTestJSON-1238776999 Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 08:53:30.622120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 08:53:30.623478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0c4d8cf4a0b74162b6f73a0b2d88ff09", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0c4d8cf4a0b74162b6f73a0b2d88ff09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c4d8cf4a0b74162b6f73a0b2d88ff09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c4d8cf4a0b74162b6f73a0b2d88ff09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:53:30.623478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-DeleteServersTestJSON-1238776999 Oct 04 08:53:30.623478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 0c4d8cf4a0b74162b6f73a0b2d88ff09 Oct 04 08:53:30.623478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238776999 Oct 04 08:53:30.623478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-DeleteServersTestJSON-1238776999-project Oct 04 08:53:30.623478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 08:53:30.623478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 08:53:30.623478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 91ccd41938954a36adb45c70e6ff41de Oct 04 08:53:30.623478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-DeleteServersTestJSON-1238776999-project Oct 04 08:53:30.623478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 08:53:30.623478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:30.623478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': '8c263bad-2d03-4333-9fa9-89c8df65a642'} Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:30.624276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:30.625493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:53:30.626536 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-43ab77bc-2e88-4e63-bb6a-6abeb635d5fe tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Returning 404 to user: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:30.626536 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-43ab77bc-2e88-4e63-bb6a-6abeb635d5fe tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 404 len: 111 microversion: 2.1 time: 0.033204 Oct 04 08:53:30.626536 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 119/256] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:30 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:30.744972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-21a361ba-73d6-470f-a4df-11c316e90d2f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:30.747214 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-21a361ba-73d6-470f-a4df-11c316e90d2f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:30.753265 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-21a361ba-73d6-470f-a4df-11c316e90d2f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:30.753730 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-21a361ba-73d6-470f-a4df-11c316e90d2f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:30.754154 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-21a361ba-73d6-470f-a4df-11c316e90d2f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:30.754834 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-21a361ba-73d6-470f-a4df-11c316e90d2f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:30.755278 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-21a361ba-73d6-470f-a4df-11c316e90d2f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:30.755693 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-21a361ba-73d6-470f-a4df-11c316e90d2f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:30.770158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-21a361ba-73d6-470f-a4df-11c316e90d2f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] HTTP exception thrown: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-21a361ba-73d6-470f-a4df-11c316e90d2f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Request method failure captured: Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642/os-volume_attachments HTTP/1.1 Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_Qdr5ss2_bxs0WLBAVUMlkKcboh1ZxcgflTN8z_NzMbIGixIkOmq2gm2TYao8bfMssTtBX4loWY1yZNsoxGVvm8oRIjGLfyuCIeqy01jSLu3yh1p2QFl9l8ZiASfOsLCS2oHkFdOtQuoqrlNDnGEkLcX2pGX9Nch_ixRjSgq7IApdU Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 0c4d8cf4a0b74162b6f73a0b2d88ff09 Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-DeleteServersTestJSON-1238776999 Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 08:53:30.774465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 08:53:30.776119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0c4d8cf4a0b74162b6f73a0b2d88ff09", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0c4d8cf4a0b74162b6f73a0b2d88ff09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c4d8cf4a0b74162b6f73a0b2d88ff09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c4d8cf4a0b74162b6f73a0b2d88ff09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:53:30.776119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-DeleteServersTestJSON-1238776999 Oct 04 08:53:30.776119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 0c4d8cf4a0b74162b6f73a0b2d88ff09 Oct 04 08:53:30.776119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238776999 Oct 04 08:53:30.776119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-DeleteServersTestJSON-1238776999-project Oct 04 08:53:30.776119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 08:53:30.776119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 08:53:30.776119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 91ccd41938954a36adb45c70e6ff41de Oct 04 08:53:30.776119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-DeleteServersTestJSON-1238776999-project Oct 04 08:53:30.776119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 08:53:30.776119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:30.776119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'server_id': '8c263bad-2d03-4333-9fa9-89c8df65a642'} Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:30.776769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:30.777817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:53:30.778864 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-21a361ba-73d6-470f-a4df-11c316e90d2f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Returning 404 to user: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:30.778864 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-21a361ba-73d6-470f-a4df-11c316e90d2f tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035315 Oct 04 08:53:30.778864 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 138/257] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 08:53:30 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:31.392673 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-87a9c184-7883-451a-ac6f-3ec28811b58f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:31.393666 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-87a9c184-7883-451a-ac6f-3ec28811b58f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:31.415081 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87a9c184-7883-451a-ac6f-3ec28811b58f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:31.416424 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87a9c184-7883-451a-ac6f-3ec28811b58f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:31.417066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87a9c184-7883-451a-ac6f-3ec28811b58f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:31.418115 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87a9c184-7883-451a-ac6f-3ec28811b58f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:31.418822 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87a9c184-7883-451a-ac6f-3ec28811b58f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:31.419479 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87a9c184-7883-451a-ac6f-3ec28811b58f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:31.598577 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-87a9c184-7883-451a-ac6f-3ec28811b58f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:31.609291 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-87a9c184-7883-451a-ac6f-3ec28811b58f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.220645 Oct 04 08:53:31.609868 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 120/258] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:31 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:32.056423 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f2301e92-8841-47ff-bbd5-2de5bdb28e38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:32.056963 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f2301e92-8841-47ff-bbd5-2de5bdb28e38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:32.063254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f2301e92-8841-47ff-bbd5-2de5bdb28e38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:32.063985 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f2301e92-8841-47ff-bbd5-2de5bdb28e38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:32.064409 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f2301e92-8841-47ff-bbd5-2de5bdb28e38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:32.065088 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f2301e92-8841-47ff-bbd5-2de5bdb28e38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:32.065518 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f2301e92-8841-47ff-bbd5-2de5bdb28e38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:32.065955 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f2301e92-8841-47ff-bbd5-2de5bdb28e38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:32.079507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-f2301e92-8841-47ff-bbd5-2de5bdb28e38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] HTTP exception thrown: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f2301e92-8841-47ff-bbd5-2de5bdb28e38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Request method failure captured: Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: DELETE /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 HTTP/1.1 Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_Qdr5ss2_bxs0WLBAVUMlkKcboh1ZxcgflTN8z_NzMbIGixIkOmq2gm2TYao8bfMssTtBX4loWY1yZNsoxGVvm8oRIjGLfyuCIeqy01jSLu3yh1p2QFl9l8ZiASfOsLCS2oHkFdOtQuoqrlNDnGEkLcX2pGX9Nch_ixRjSgq7IApdU Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 0c4d8cf4a0b74162b6f73a0b2d88ff09 Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-DeleteServersTestJSON-1238776999 Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 08:53:32.081731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 08:53:32.083091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0c4d8cf4a0b74162b6f73a0b2d88ff09", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0c4d8cf4a0b74162b6f73a0b2d88ff09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c4d8cf4a0b74162b6f73a0b2d88ff09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c4d8cf4a0b74162b6f73a0b2d88ff09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:53:32.083091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-DeleteServersTestJSON-1238776999 Oct 04 08:53:32.083091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 0c4d8cf4a0b74162b6f73a0b2d88ff09 Oct 04 08:53:32.083091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238776999 Oct 04 08:53:32.083091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-DeleteServersTestJSON-1238776999-project Oct 04 08:53:32.083091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 08:53:32.083091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 08:53:32.083091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 91ccd41938954a36adb45c70e6ff41de Oct 04 08:53:32.083091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-DeleteServersTestJSON-1238776999-project Oct 04 08:53:32.083091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 08:53:32.083091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:32.083091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': '8c263bad-2d03-4333-9fa9-89c8df65a642'} Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:32.083809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:32.084878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:53:32.085908 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f2301e92-8841-47ff-bbd5-2de5bdb28e38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Returning 404 to user: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:32.085908 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f2301e92-8841-47ff-bbd5-2de5bdb28e38 tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 404 len: 111 microversion: 2.1 time: 0.030689 Oct 04 08:53:32.085908 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 139/259] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 08:53:32 2022] DELETE /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:32.091721 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c05defaf-28b5-43ec-bb8f-223bd175d3ee tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:32.092373 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c05defaf-28b5-43ec-bb8f-223bd175d3ee tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] [instance: 8c263bad-2d03-4333-9fa9-89c8df65a642] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:32.098841 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c05defaf-28b5-43ec-bb8f-223bd175d3ee tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:32.099335 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c05defaf-28b5-43ec-bb8f-223bd175d3ee tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:32.099769 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c05defaf-28b5-43ec-bb8f-223bd175d3ee tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:32.100509 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c05defaf-28b5-43ec-bb8f-223bd175d3ee tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:32.100967 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c05defaf-28b5-43ec-bb8f-223bd175d3ee tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:32.101382 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c05defaf-28b5-43ec-bb8f-223bd175d3ee tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:32.114976 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-c05defaf-28b5-43ec-bb8f-223bd175d3ee tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] HTTP exception thrown: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c05defaf-28b5-43ec-bb8f-223bd175d3ee tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Request method failure captured: Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 HTTP/1.1 Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_Qdr5ss2_bxs0WLBAVUMlkKcboh1ZxcgflTN8z_NzMbIGixIkOmq2gm2TYao8bfMssTtBX4loWY1yZNsoxGVvm8oRIjGLfyuCIeqy01jSLu3yh1p2QFl9l8ZiASfOsLCS2oHkFdOtQuoqrlNDnGEkLcX2pGX9Nch_ixRjSgq7IApdU Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 0c4d8cf4a0b74162b6f73a0b2d88ff09 Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-DeleteServersTestJSON-1238776999 Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 08:53:32.116518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 08:53:32.117785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0c4d8cf4a0b74162b6f73a0b2d88ff09", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0c4d8cf4a0b74162b6f73a0b2d88ff09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c4d8cf4a0b74162b6f73a0b2d88ff09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c4d8cf4a0b74162b6f73a0b2d88ff09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:53:32.117785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-DeleteServersTestJSON-1238776999 Oct 04 08:53:32.117785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 0c4d8cf4a0b74162b6f73a0b2d88ff09 Oct 04 08:53:32.117785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-DeleteServersTestJSON-1238776999 Oct 04 08:53:32.117785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-DeleteServersTestJSON-1238776999-project Oct 04 08:53:32.117785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 08:53:32.117785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 08:53:32.117785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 91ccd41938954a36adb45c70e6ff41de Oct 04 08:53:32.117785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-DeleteServersTestJSON-1238776999-project Oct 04 08:53:32.117785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 08:53:32.117785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:32.117785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': '8c263bad-2d03-4333-9fa9-89c8df65a642'} Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:32.118467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. Oct 04 08:53:32.119959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:53:32.121195 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c05defaf-28b5-43ec-bb8f-223bd175d3ee tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] Returning 404 to user: Instance 8c263bad-2d03-4333-9fa9-89c8df65a642 could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:32.121195 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c05defaf-28b5-43ec-bb8f-223bd175d3ee tempest-DeleteServersTestJSON-1238776999 tempest-DeleteServersTestJSON-1238776999-project] 10.222.0.44 "GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642" status: 404 len: 111 microversion: 2.1 time: 0.030112 Oct 04 08:53:32.121195 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 121/260] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:32 2022] GET /compute/v2.1/servers/8c263bad-2d03-4333-9fa9-89c8df65a642 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:32.636838 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a862faba-43b6-4680-95ce-e774541243ae tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:32.637881 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a862faba-43b6-4680-95ce-e774541243ae tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:32.645075 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a862faba-43b6-4680-95ce-e774541243ae tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:32.645963 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a862faba-43b6-4680-95ce-e774541243ae tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:32.647108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a862faba-43b6-4680-95ce-e774541243ae tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:32.648107 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a862faba-43b6-4680-95ce-e774541243ae tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:32.649003 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a862faba-43b6-4680-95ce-e774541243ae tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:32.649666 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a862faba-43b6-4680-95ce-e774541243ae tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:32.844726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-a862faba-43b6-4680-95ce-e774541243ae tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:32.856904 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a862faba-43b6-4680-95ce-e774541243ae tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.226314 Oct 04 08:53:32.857603 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 140/261] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:32 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:33.888182 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2fa528c1-fb62-4b14-b7d0-db3b72cf387a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:33.888998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2fa528c1-fb62-4b14-b7d0-db3b72cf387a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:33.904645 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2fa528c1-fb62-4b14-b7d0-db3b72cf387a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:33.905466 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2fa528c1-fb62-4b14-b7d0-db3b72cf387a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:33.906125 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2fa528c1-fb62-4b14-b7d0-db3b72cf387a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:33.907043 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2fa528c1-fb62-4b14-b7d0-db3b72cf387a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:33.907717 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2fa528c1-fb62-4b14-b7d0-db3b72cf387a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:33.908345 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2fa528c1-fb62-4b14-b7d0-db3b72cf387a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:34.137478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2fa528c1-fb62-4b14-b7d0-db3b72cf387a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:34.147054 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2fa528c1-fb62-4b14-b7d0-db3b72cf387a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.265537 Oct 04 08:53:34.151294 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 122/262] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:33 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:35.182280 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-bb49fb83-e3bf-43d2-91ed-6c8359383cf0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:35.183654 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-bb49fb83-e3bf-43d2-91ed-6c8359383cf0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:35.190346 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bb49fb83-e3bf-43d2-91ed-6c8359383cf0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:35.190998 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bb49fb83-e3bf-43d2-91ed-6c8359383cf0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:35.191608 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bb49fb83-e3bf-43d2-91ed-6c8359383cf0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:35.192468 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bb49fb83-e3bf-43d2-91ed-6c8359383cf0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:35.192912 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bb49fb83-e3bf-43d2-91ed-6c8359383cf0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:35.193319 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bb49fb83-e3bf-43d2-91ed-6c8359383cf0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:35.532864 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-bb49fb83-e3bf-43d2-91ed-6c8359383cf0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:35.546105 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-bb49fb83-e3bf-43d2-91ed-6c8359383cf0 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.367781 Oct 04 08:53:35.548887 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 141/263] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:35 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:36.571857 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d934326c-fa48-45c4-933e-d052e71d35bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:36.572924 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d934326c-fa48-45c4-933e-d052e71d35bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:36.583565 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d934326c-fa48-45c4-933e-d052e71d35bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:36.584412 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d934326c-fa48-45c4-933e-d052e71d35bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:36.585502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d934326c-fa48-45c4-933e-d052e71d35bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:36.586464 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d934326c-fa48-45c4-933e-d052e71d35bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:36.587136 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d934326c-fa48-45c4-933e-d052e71d35bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:36.588402 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d934326c-fa48-45c4-933e-d052e71d35bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:36.804362 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d934326c-fa48-45c4-933e-d052e71d35bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:36.815783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d934326c-fa48-45c4-933e-d052e71d35bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.249213 Oct 04 08:53:36.827918 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 123/264] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:36 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:37.839714 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b55ef0ab-e89b-4ae6-bf41-58eed68e96d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:37.841211 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b55ef0ab-e89b-4ae6-bf41-58eed68e96d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:37.850908 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b55ef0ab-e89b-4ae6-bf41-58eed68e96d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:37.852702 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b55ef0ab-e89b-4ae6-bf41-58eed68e96d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:37.853479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b55ef0ab-e89b-4ae6-bf41-58eed68e96d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:37.854905 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b55ef0ab-e89b-4ae6-bf41-58eed68e96d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:37.855772 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b55ef0ab-e89b-4ae6-bf41-58eed68e96d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:37.856950 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b55ef0ab-e89b-4ae6-bf41-58eed68e96d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:38.080034 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b55ef0ab-e89b-4ae6-bf41-58eed68e96d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:38.088995 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b55ef0ab-e89b-4ae6-bf41-58eed68e96d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.254257 Oct 04 08:53:38.090052 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 142/265] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:37 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:39.122229 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6fc4c456-f603-4637-b73c-ebcb72125583 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:39.123630 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6fc4c456-f603-4637-b73c-ebcb72125583 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:39.139696 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6fc4c456-f603-4637-b73c-ebcb72125583 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:39.140931 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6fc4c456-f603-4637-b73c-ebcb72125583 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:39.142672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6fc4c456-f603-4637-b73c-ebcb72125583 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:39.143735 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6fc4c456-f603-4637-b73c-ebcb72125583 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:39.144403 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6fc4c456-f603-4637-b73c-ebcb72125583 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:39.144981 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6fc4c456-f603-4637-b73c-ebcb72125583 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:39.403448 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6fc4c456-f603-4637-b73c-ebcb72125583 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:39.415102 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6fc4c456-f603-4637-b73c-ebcb72125583 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.301742 Oct 04 08:53:39.415786 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 124/266] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:39 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:40.445989 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0ff614ff-0024-4c65-b9a4-48ad5fee8a46 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:40.446688 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0ff614ff-0024-4c65-b9a4-48ad5fee8a46 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:40.454529 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0ff614ff-0024-4c65-b9a4-48ad5fee8a46 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:40.455413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0ff614ff-0024-4c65-b9a4-48ad5fee8a46 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:40.456247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0ff614ff-0024-4c65-b9a4-48ad5fee8a46 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:40.457236 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0ff614ff-0024-4c65-b9a4-48ad5fee8a46 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:40.457873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0ff614ff-0024-4c65-b9a4-48ad5fee8a46 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:40.458469 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0ff614ff-0024-4c65-b9a4-48ad5fee8a46 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:40.687057 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0ff614ff-0024-4c65-b9a4-48ad5fee8a46 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:40.698198 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0ff614ff-0024-4c65-b9a4-48ad5fee8a46 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.256542 Oct 04 08:53:40.700349 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 143/267] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:40 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:41.729736 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0257549a-e898-44ad-b7be-0e77bd60692e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:41.738773 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0257549a-e898-44ad-b7be-0e77bd60692e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:41.763229 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0257549a-e898-44ad-b7be-0e77bd60692e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:41.764559 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0257549a-e898-44ad-b7be-0e77bd60692e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:41.765719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0257549a-e898-44ad-b7be-0e77bd60692e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:41.772170 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0257549a-e898-44ad-b7be-0e77bd60692e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:41.773114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0257549a-e898-44ad-b7be-0e77bd60692e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:41.776892 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0257549a-e898-44ad-b7be-0e77bd60692e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:42.029554 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0257549a-e898-44ad-b7be-0e77bd60692e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:42.038952 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0257549a-e898-44ad-b7be-0e77bd60692e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.319075 Oct 04 08:53:42.039842 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 125/268] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:41 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:43.064275 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-14a650b3-7a84-4dad-bedc-6fb1a2b24b59 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:43.064888 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-14a650b3-7a84-4dad-bedc-6fb1a2b24b59 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:43.083117 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-14a650b3-7a84-4dad-bedc-6fb1a2b24b59 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:43.084877 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-14a650b3-7a84-4dad-bedc-6fb1a2b24b59 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:43.085313 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-14a650b3-7a84-4dad-bedc-6fb1a2b24b59 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:43.086358 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-14a650b3-7a84-4dad-bedc-6fb1a2b24b59 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:43.086456 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-14a650b3-7a84-4dad-bedc-6fb1a2b24b59 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:43.086966 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-14a650b3-7a84-4dad-bedc-6fb1a2b24b59 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:43.367195 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-14a650b3-7a84-4dad-bedc-6fb1a2b24b59 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:43.386986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-14a650b3-7a84-4dad-bedc-6fb1a2b24b59 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.326734 Oct 04 08:53:43.387658 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 144/269] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:43 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:43.892341 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6ff2fb84-11aa-4469-ab24-091fffcfff2b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Action: 'create', calling method: .version_select at 0x7ff92e4d39d0>, body: {"keypair": {"name": "tempest-keypair-203502749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYlId/k84lbRZ2fmI2j9gFcnTnW8ugHf4WxmjO3sLePAE302uTO6BiR2gzxFxq475ozu3PBknWZRuOOpIU+0LlRsWNo+yTG2sXTKIBWB6Ug0nk17ws7Nybm+lnjG4MFHw=="}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:43.913714 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-6ff2fb84-11aa-4469-ab24-091fffcfff2b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Getting quotas for project b7ad37ea522247c6b28ea40e1bc43669. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:53:43.918702 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-6ff2fb84-11aa-4469-ab24-091fffcfff2b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Getting quotas for user e71984f02fcd4deba5e1430ec85b8705 and project b7ad37ea522247c6b28ea40e1bc43669. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:53:43.953314 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6ff2fb84-11aa-4469-ab24-091fffcfff2b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.313697 Oct 04 08:53:43.954257 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 126/270] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Oct 4 08:53:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:44.415558 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-00b054c2-d8af-4e2e-ab27-ef558812fe5a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:44.416215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-00b054c2-d8af-4e2e-ab27-ef558812fe5a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:44.419714 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=40 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:44.427313 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-00b054c2-d8af-4e2e-ab27-ef558812fe5a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:44.428295 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-00b054c2-d8af-4e2e-ab27-ef558812fe5a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:44.429094 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-00b054c2-d8af-4e2e-ab27-ef558812fe5a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:44.430000 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-00b054c2-d8af-4e2e-ab27-ef558812fe5a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:44.430584 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-00b054c2-d8af-4e2e-ab27-ef558812fe5a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:44.431194 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-00b054c2-d8af-4e2e-ab27-ef558812fe5a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:44.635686 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-00b054c2-d8af-4e2e-ab27-ef558812fe5a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:44.648122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-00b054c2-d8af-4e2e-ab27-ef558812fe5a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.236907 Oct 04 08:53:44.649234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 145/271] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:44 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:45.601054 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1998361583", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e5acea3-b968-4513-b5c4-a35e676fc1e7"}], "security_groups": [{"name": "tempest-securitygroup--1118586712"}], "key_name": "tempest-keypair-203502749", "user_data": "}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:45.672321 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b8da1339-2e93-4cb2-8f15-2d8424acca67 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:45.672968 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b8da1339-2e93-4cb2-8f15-2d8424acca67 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:45.679844 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8da1339-2e93-4cb2-8f15-2d8424acca67 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:45.680312 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8da1339-2e93-4cb2-8f15-2d8424acca67 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:45.680734 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8da1339-2e93-4cb2-8f15-2d8424acca67 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:45.681420 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8da1339-2e93-4cb2-8f15-2d8424acca67 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:45.682290 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8da1339-2e93-4cb2-8f15-2d8424acca67 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:45.682712 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8da1339-2e93-4cb2-8f15-2d8424acca67 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:45.849148 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b8da1339-2e93-4cb2-8f15-2d8424acca67 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:45.857627 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b8da1339-2e93-4cb2-8f15-2d8424acca67 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.189331 Oct 04 08:53:45.858323 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 146/272] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:45 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:46.057323 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.network.neutron [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] validate_networks() for [('8e5acea3-b968-4513-b5c4-a35e676fc1e7', None, None, None, None, None)] {{(pid=142439) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:53:46.624225 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Flavor limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:53:46.624766 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Image limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:53:46.625202 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Flavor pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:53:46.625967 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Image pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:53:46.626569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:53:46.637001 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:46.637568 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:46.638372 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:46.639165 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:46.639682 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:46.640326 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:46.659092 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Getting quotas for project b7ad37ea522247c6b28ea40e1bc43669. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:53:46.663370 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Getting quotas for user e71984f02fcd4deba5e1430ec85b8705 and project b7ad37ea522247c6b28ea40e1bc43669. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:53:46.676943 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Going to run 1 instances... {{(pid=142439) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:53:46.679825 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:53:46.737832 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-17c485f6-51b6-4db0-b4c9-4d056c774660 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.142814 Oct 04 08:53:46.738494 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 127/273] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 08:53:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:53:46.750503 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-202bea45-c71b-4eb7-ac27-caa9a46f4c91 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:46.751294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-202bea45-c71b-4eb7-ac27-caa9a46f4c91 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:46.808239 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-202bea45-c71b-4eb7-ac27-caa9a46f4c91 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:46.816302 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-202bea45-c71b-4eb7-ac27-caa9a46f4c91 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1237 microversion: 2.1 time: 0.069947 Oct 04 08:53:46.817036 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 147/274] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:46 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:46.882535 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e49bbdce-41e0-474f-9890-09e0a4e7288c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:46.883227 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e49bbdce-41e0-474f-9890-09e0a4e7288c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:46.889583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e49bbdce-41e0-474f-9890-09e0a4e7288c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:46.891532 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e49bbdce-41e0-474f-9890-09e0a4e7288c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:46.892176 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e49bbdce-41e0-474f-9890-09e0a4e7288c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:46.893128 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e49bbdce-41e0-474f-9890-09e0a4e7288c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:46.893373 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e49bbdce-41e0-474f-9890-09e0a4e7288c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:46.894009 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e49bbdce-41e0-474f-9890-09e0a4e7288c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:47.045551 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e49bbdce-41e0-474f-9890-09e0a4e7288c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:47.055218 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e49bbdce-41e0-474f-9890-09e0a4e7288c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.176723 Oct 04 08:53:47.056818 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 128/275] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:46 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:47.838812 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-fd64bee9-5089-4430-816a-16f055383b03 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:47.839408 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-fd64bee9-5089-4430-816a-16f055383b03 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:47.845858 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fd64bee9-5089-4430-816a-16f055383b03 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:47.846340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fd64bee9-5089-4430-816a-16f055383b03 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:47.846743 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fd64bee9-5089-4430-816a-16f055383b03 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:47.847466 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fd64bee9-5089-4430-816a-16f055383b03 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:47.847921 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fd64bee9-5089-4430-816a-16f055383b03 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:47.848339 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fd64bee9-5089-4430-816a-16f055383b03 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:47.911697 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-fd64bee9-5089-4430-816a-16f055383b03 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:47.923343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-fd64bee9-5089-4430-816a-16f055383b03 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1241 microversion: 2.1 time: 0.088231 Oct 04 08:53:47.924165 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 148/276] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:47 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:48.078860 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0e051294-ad6e-45d4-a525-92219a52f7ec tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:48.079474 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0e051294-ad6e-45d4-a525-92219a52f7ec tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:48.086101 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e051294-ad6e-45d4-a525-92219a52f7ec tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:48.086594 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e051294-ad6e-45d4-a525-92219a52f7ec tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:48.087018 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e051294-ad6e-45d4-a525-92219a52f7ec tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:48.087699 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e051294-ad6e-45d4-a525-92219a52f7ec tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:48.088183 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e051294-ad6e-45d4-a525-92219a52f7ec tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:48.088601 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0e051294-ad6e-45d4-a525-92219a52f7ec tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:48.221171 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0e051294-ad6e-45d4-a525-92219a52f7ec tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:48.232878 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0e051294-ad6e-45d4-a525-92219a52f7ec tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.157820 Oct 04 08:53:48.233759 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 129/277] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:48 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:48.950881 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4451fe11-9d8d-418d-a78a-1ded304a60fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:48.951688 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4451fe11-9d8d-418d-a78a-1ded304a60fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:48.959214 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4451fe11-9d8d-418d-a78a-1ded304a60fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:48.959701 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4451fe11-9d8d-418d-a78a-1ded304a60fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:48.960185 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4451fe11-9d8d-418d-a78a-1ded304a60fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:48.960896 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4451fe11-9d8d-418d-a78a-1ded304a60fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:48.961345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4451fe11-9d8d-418d-a78a-1ded304a60fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:48.961766 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4451fe11-9d8d-418d-a78a-1ded304a60fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:49.022474 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4451fe11-9d8d-418d-a78a-1ded304a60fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:49.030532 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4451fe11-9d8d-418d-a78a-1ded304a60fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1241 microversion: 2.1 time: 0.086514 Oct 04 08:53:49.031097 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 149/278] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:48 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:49.257590 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-68b0be4b-88ec-4989-8103-ee0844ed7c21 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:49.258118 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-68b0be4b-88ec-4989-8103-ee0844ed7c21 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:49.264708 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-68b0be4b-88ec-4989-8103-ee0844ed7c21 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:49.265183 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-68b0be4b-88ec-4989-8103-ee0844ed7c21 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:49.265614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-68b0be4b-88ec-4989-8103-ee0844ed7c21 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:49.266293 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-68b0be4b-88ec-4989-8103-ee0844ed7c21 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:49.266736 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-68b0be4b-88ec-4989-8103-ee0844ed7c21 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:49.267293 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-68b0be4b-88ec-4989-8103-ee0844ed7c21 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:49.397976 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-68b0be4b-88ec-4989-8103-ee0844ed7c21 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:49.405756 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-68b0be4b-88ec-4989-8103-ee0844ed7c21 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.152243 Oct 04 08:53:49.406392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 130/279] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:49 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:50.057248 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-737120ad-0ec7-4a46-843c-6b389174b40c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:50.058209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-737120ad-0ec7-4a46-843c-6b389174b40c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:50.067290 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-737120ad-0ec7-4a46-843c-6b389174b40c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:50.067771 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-737120ad-0ec7-4a46-843c-6b389174b40c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:50.068238 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-737120ad-0ec7-4a46-843c-6b389174b40c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:50.068926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-737120ad-0ec7-4a46-843c-6b389174b40c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:50.069371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-737120ad-0ec7-4a46-843c-6b389174b40c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:50.069772 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-737120ad-0ec7-4a46-843c-6b389174b40c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:50.130093 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-737120ad-0ec7-4a46-843c-6b389174b40c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:50.139623 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-737120ad-0ec7-4a46-843c-6b389174b40c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1241 microversion: 2.1 time: 0.088904 Oct 04 08:53:50.140226 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 150/280] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:50 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:50.431205 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-890dc9e3-364f-4bc9-a051-1370152ebc9c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:50.432194 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-890dc9e3-364f-4bc9-a051-1370152ebc9c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:50.442425 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-890dc9e3-364f-4bc9-a051-1370152ebc9c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:50.443156 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-890dc9e3-364f-4bc9-a051-1370152ebc9c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:50.443812 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-890dc9e3-364f-4bc9-a051-1370152ebc9c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:50.444922 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-890dc9e3-364f-4bc9-a051-1370152ebc9c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:50.445674 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-890dc9e3-364f-4bc9-a051-1370152ebc9c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:50.446321 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-890dc9e3-364f-4bc9-a051-1370152ebc9c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:50.585327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-890dc9e3-364f-4bc9-a051-1370152ebc9c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:50.596496 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-890dc9e3-364f-4bc9-a051-1370152ebc9c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.171018 Oct 04 08:53:50.597070 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 131/281] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:50 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:51.174238 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7e545d84-51d3-48dd-bfa2-cebad056488d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:51.175055 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7e545d84-51d3-48dd-bfa2-cebad056488d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:51.183278 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7e545d84-51d3-48dd-bfa2-cebad056488d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:51.183924 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7e545d84-51d3-48dd-bfa2-cebad056488d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:51.184220 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7e545d84-51d3-48dd-bfa2-cebad056488d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:51.184901 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7e545d84-51d3-48dd-bfa2-cebad056488d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:51.185366 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7e545d84-51d3-48dd-bfa2-cebad056488d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:51.185874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7e545d84-51d3-48dd-bfa2-cebad056488d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:51.205898 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=100 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:51.248911 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7e545d84-51d3-48dd-bfa2-cebad056488d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:51.256719 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7e545d84-51d3-48dd-bfa2-cebad056488d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1241 microversion: 2.1 time: 0.091119 Oct 04 08:53:51.257275 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 151/282] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:51 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:51.622264 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9eb126d1-d0fb-468e-b386-14edfd43bbd9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:51.622867 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9eb126d1-d0fb-468e-b386-14edfd43bbd9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:51.630783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9eb126d1-d0fb-468e-b386-14edfd43bbd9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:51.631271 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9eb126d1-d0fb-468e-b386-14edfd43bbd9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:51.631709 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9eb126d1-d0fb-468e-b386-14edfd43bbd9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:51.632435 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9eb126d1-d0fb-468e-b386-14edfd43bbd9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:51.632889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9eb126d1-d0fb-468e-b386-14edfd43bbd9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:51.633321 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9eb126d1-d0fb-468e-b386-14edfd43bbd9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:51.653749 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=100 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:51.776636 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9eb126d1-d0fb-468e-b386-14edfd43bbd9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:51.784899 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9eb126d1-d0fb-468e-b386-14edfd43bbd9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.168620 Oct 04 08:53:51.785476 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 132/283] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:51 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:52.284507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e6859c59-8933-4280-a1b9-a33dde47a631 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:52.286181 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e6859c59-8933-4280-a1b9-a33dde47a631 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:52.295757 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6859c59-8933-4280-a1b9-a33dde47a631 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:52.296272 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6859c59-8933-4280-a1b9-a33dde47a631 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:52.296692 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6859c59-8933-4280-a1b9-a33dde47a631 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:52.297372 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6859c59-8933-4280-a1b9-a33dde47a631 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:52.297818 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6859c59-8933-4280-a1b9-a33dde47a631 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:52.298229 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6859c59-8933-4280-a1b9-a33dde47a631 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:52.365291 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e6859c59-8933-4280-a1b9-a33dde47a631 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:52.373313 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e6859c59-8933-4280-a1b9-a33dde47a631 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1241 microversion: 2.1 time: 0.093909 Oct 04 08:53:52.373889 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 152/284] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:52 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:52.807989 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-623c5251-d5f9-4d69-8bf6-c0b48b850ccd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:52.808702 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-623c5251-d5f9-4d69-8bf6-c0b48b850ccd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:52.815230 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-623c5251-d5f9-4d69-8bf6-c0b48b850ccd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:52.815704 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-623c5251-d5f9-4d69-8bf6-c0b48b850ccd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:52.816299 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-623c5251-d5f9-4d69-8bf6-c0b48b850ccd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:52.817178 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-623c5251-d5f9-4d69-8bf6-c0b48b850ccd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:52.817819 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-623c5251-d5f9-4d69-8bf6-c0b48b850ccd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:52.818246 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-623c5251-d5f9-4d69-8bf6-c0b48b850ccd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:52.956459 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-623c5251-d5f9-4d69-8bf6-c0b48b850ccd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:52.966734 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-623c5251-d5f9-4d69-8bf6-c0b48b850ccd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.162647 Oct 04 08:53:52.967308 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 133/285] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:52 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:53.396738 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-594fbcef-472a-4657-99cf-7c606ae689ea tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:53.397354 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-594fbcef-472a-4657-99cf-7c606ae689ea tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:53.404328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-594fbcef-472a-4657-99cf-7c606ae689ea tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:53.405108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-594fbcef-472a-4657-99cf-7c606ae689ea tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:53.405701 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-594fbcef-472a-4657-99cf-7c606ae689ea tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:53.406679 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-594fbcef-472a-4657-99cf-7c606ae689ea tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:53.407129 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-594fbcef-472a-4657-99cf-7c606ae689ea tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:53.407550 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-594fbcef-472a-4657-99cf-7c606ae689ea tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:53.472475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-594fbcef-472a-4657-99cf-7c606ae689ea tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:53.481013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-594fbcef-472a-4657-99cf-7c606ae689ea tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1289 microversion: 2.1 time: 0.088758 Oct 04 08:53:53.481585 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 153/286] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:53 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:53.990705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-402433ee-0ef6-412f-94e0-60960a4e8aad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:53.991871 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-402433ee-0ef6-412f-94e0-60960a4e8aad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:53.998393 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-402433ee-0ef6-412f-94e0-60960a4e8aad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:53.998875 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-402433ee-0ef6-412f-94e0-60960a4e8aad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:53.999333 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-402433ee-0ef6-412f-94e0-60960a4e8aad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:54.000045 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-402433ee-0ef6-412f-94e0-60960a4e8aad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:54.000486 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-402433ee-0ef6-412f-94e0-60960a4e8aad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:54.001071 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-402433ee-0ef6-412f-94e0-60960a4e8aad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:54.141735 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-402433ee-0ef6-412f-94e0-60960a4e8aad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:54.150005 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-402433ee-0ef6-412f-94e0-60960a4e8aad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.163616 Oct 04 08:53:54.151221 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 134/287] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:53 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:54.505064 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-3d4f712b-c82c-46d4-ad96-dc6e65afd664 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:54.505700 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-3d4f712b-c82c-46d4-ad96-dc6e65afd664 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:54.514916 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3d4f712b-c82c-46d4-ad96-dc6e65afd664 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:54.515615 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3d4f712b-c82c-46d4-ad96-dc6e65afd664 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:54.516109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3d4f712b-c82c-46d4-ad96-dc6e65afd664 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:54.516916 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3d4f712b-c82c-46d4-ad96-dc6e65afd664 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:54.517331 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3d4f712b-c82c-46d4-ad96-dc6e65afd664 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:54.517892 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3d4f712b-c82c-46d4-ad96-dc6e65afd664 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:54.583073 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3d4f712b-c82c-46d4-ad96-dc6e65afd664 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:54.590690 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-3d4f712b-c82c-46d4-ad96-dc6e65afd664 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1289 microversion: 2.1 time: 0.089512 Oct 04 08:53:54.591245 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 154/288] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:54 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:55.177763 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b5a1303a-94e8-4906-aae5-1b7b27c3c24d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:55.178823 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b5a1303a-94e8-4906-aae5-1b7b27c3c24d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:55.189728 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5a1303a-94e8-4906-aae5-1b7b27c3c24d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:55.190442 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5a1303a-94e8-4906-aae5-1b7b27c3c24d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:55.191162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5a1303a-94e8-4906-aae5-1b7b27c3c24d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:55.192366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5a1303a-94e8-4906-aae5-1b7b27c3c24d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:55.193125 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5a1303a-94e8-4906-aae5-1b7b27c3c24d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:55.193802 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5a1303a-94e8-4906-aae5-1b7b27c3c24d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:55.334483 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b5a1303a-94e8-4906-aae5-1b7b27c3c24d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:55.342544 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b5a1303a-94e8-4906-aae5-1b7b27c3c24d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.171275 Oct 04 08:53:55.343120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 135/289] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:55 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:55.616929 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-938d8c7a-91e3-4b78-b1c3-2651b8086cbd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:55.617708 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-938d8c7a-91e3-4b78-b1c3-2651b8086cbd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:55.626138 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-938d8c7a-91e3-4b78-b1c3-2651b8086cbd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:55.626747 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-938d8c7a-91e3-4b78-b1c3-2651b8086cbd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:55.627322 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-938d8c7a-91e3-4b78-b1c3-2651b8086cbd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:55.628286 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-938d8c7a-91e3-4b78-b1c3-2651b8086cbd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:55.628882 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-938d8c7a-91e3-4b78-b1c3-2651b8086cbd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:55.629443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-938d8c7a-91e3-4b78-b1c3-2651b8086cbd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:55.694337 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-938d8c7a-91e3-4b78-b1c3-2651b8086cbd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:55.702276 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-938d8c7a-91e3-4b78-b1c3-2651b8086cbd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1289 microversion: 2.1 time: 0.092003 Oct 04 08:53:55.702843 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 155/290] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:55 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:56.370133 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8e66f992-fabb-4058-944b-e6d076dae205 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:56.371212 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8e66f992-fabb-4058-944b-e6d076dae205 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:56.382321 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8e66f992-fabb-4058-944b-e6d076dae205 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:56.383112 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8e66f992-fabb-4058-944b-e6d076dae205 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:56.383821 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8e66f992-fabb-4058-944b-e6d076dae205 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:56.385234 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8e66f992-fabb-4058-944b-e6d076dae205 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:56.386011 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8e66f992-fabb-4058-944b-e6d076dae205 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:56.386680 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8e66f992-fabb-4058-944b-e6d076dae205 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:56.517554 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8e66f992-fabb-4058-944b-e6d076dae205 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:56.525773 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8e66f992-fabb-4058-944b-e6d076dae205 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.162501 Oct 04 08:53:56.526352 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 136/291] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:56 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:56.725179 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b605e3d6-40f2-4eea-b4c6-adb71cd129cf tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:56.725734 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b605e3d6-40f2-4eea-b4c6-adb71cd129cf tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:56.732099 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b605e3d6-40f2-4eea-b4c6-adb71cd129cf tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:56.732584 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b605e3d6-40f2-4eea-b4c6-adb71cd129cf tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:56.733013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b605e3d6-40f2-4eea-b4c6-adb71cd129cf tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:56.733797 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b605e3d6-40f2-4eea-b4c6-adb71cd129cf tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:56.734252 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b605e3d6-40f2-4eea-b4c6-adb71cd129cf tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:56.734673 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b605e3d6-40f2-4eea-b4c6-adb71cd129cf tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:56.796862 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b605e3d6-40f2-4eea-b4c6-adb71cd129cf tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:56.805067 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b605e3d6-40f2-4eea-b4c6-adb71cd129cf tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1289 microversion: 2.1 time: 0.083998 Oct 04 08:53:56.805712 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 156/292] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:56 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:57.553161 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-372f0da1-8eb2-483a-98a0-d1b543a41a57 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:57.554283 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-372f0da1-8eb2-483a-98a0-d1b543a41a57 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:57.558686 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:57.559772 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=10 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:57.569636 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-372f0da1-8eb2-483a-98a0-d1b543a41a57 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:57.570129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-372f0da1-8eb2-483a-98a0-d1b543a41a57 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:57.570561 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-372f0da1-8eb2-483a-98a0-d1b543a41a57 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:57.571263 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-372f0da1-8eb2-483a-98a0-d1b543a41a57 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:57.571714 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-372f0da1-8eb2-483a-98a0-d1b543a41a57 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:57.572223 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-372f0da1-8eb2-483a-98a0-d1b543a41a57 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:57.708046 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-372f0da1-8eb2-483a-98a0-d1b543a41a57 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:57.716788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-372f0da1-8eb2-483a-98a0-d1b543a41a57 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.170345 Oct 04 08:53:57.717361 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 137/293] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:57 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:57.832228 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6479a87d-5a29-4f99-aecb-b74a3fdde589 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:57.833245 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6479a87d-5a29-4f99-aecb-b74a3fdde589 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:57.835477 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:57.841306 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6479a87d-5a29-4f99-aecb-b74a3fdde589 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:57.841787 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6479a87d-5a29-4f99-aecb-b74a3fdde589 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:57.842221 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6479a87d-5a29-4f99-aecb-b74a3fdde589 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:57.842906 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6479a87d-5a29-4f99-aecb-b74a3fdde589 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:57.843354 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6479a87d-5a29-4f99-aecb-b74a3fdde589 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:57.843789 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6479a87d-5a29-4f99-aecb-b74a3fdde589 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:57.907545 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6479a87d-5a29-4f99-aecb-b74a3fdde589 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:57.915588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6479a87d-5a29-4f99-aecb-b74a3fdde589 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1289 microversion: 2.1 time: 0.090256 Oct 04 08:53:57.916200 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 157/294] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:57 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:58.744257 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4f008dba-cd05-4164-8661-7f82257f1239 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:58.745274 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4f008dba-cd05-4164-8661-7f82257f1239 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:58.756123 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4f008dba-cd05-4164-8661-7f82257f1239 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:58.756627 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4f008dba-cd05-4164-8661-7f82257f1239 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:58.757060 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4f008dba-cd05-4164-8661-7f82257f1239 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:58.757747 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4f008dba-cd05-4164-8661-7f82257f1239 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:58.758195 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4f008dba-cd05-4164-8661-7f82257f1239 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:58.758612 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4f008dba-cd05-4164-8661-7f82257f1239 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:58.907597 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4f008dba-cd05-4164-8661-7f82257f1239 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:58.915505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4f008dba-cd05-4164-8661-7f82257f1239 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.178170 Oct 04 08:53:58.916296 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 138/295] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:58 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:58.938658 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-41bf22df-58c2-4790-bf9c-1611ad921e1f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:58.940598 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-41bf22df-58c2-4790-bf9c-1611ad921e1f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:58.946736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41bf22df-58c2-4790-bf9c-1611ad921e1f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:58.947452 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41bf22df-58c2-4790-bf9c-1611ad921e1f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:58.947904 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41bf22df-58c2-4790-bf9c-1611ad921e1f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:58.948607 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41bf22df-58c2-4790-bf9c-1611ad921e1f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:58.949061 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41bf22df-58c2-4790-bf9c-1611ad921e1f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:58.949482 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41bf22df-58c2-4790-bf9c-1611ad921e1f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:59.010953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-41bf22df-58c2-4790-bf9c-1611ad921e1f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:59.018757 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-41bf22df-58c2-4790-bf9c-1611ad921e1f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1289 microversion: 2.1 time: 0.083993 Oct 04 08:53:59.019318 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 158/296] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:58 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:59.939548 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d0faf7b5-8836-4830-88e1-71119d779ee7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:59.940163 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d0faf7b5-8836-4830-88e1-71119d779ee7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:59.942389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:59.947613 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0faf7b5-8836-4830-88e1-71119d779ee7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:59.948128 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0faf7b5-8836-4830-88e1-71119d779ee7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:59.948553 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0faf7b5-8836-4830-88e1-71119d779ee7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:59.949237 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0faf7b5-8836-4830-88e1-71119d779ee7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:59.949687 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0faf7b5-8836-4830-88e1-71119d779ee7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:59.950103 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0faf7b5-8836-4830-88e1-71119d779ee7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:00.041015 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9fec5639-6c60-4229-97c0-d6a37360dbc1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:00.041616 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9fec5639-6c60-4229-97c0-d6a37360dbc1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:00.047529 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9fec5639-6c60-4229-97c0-d6a37360dbc1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:00.048278 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9fec5639-6c60-4229-97c0-d6a37360dbc1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:00.048701 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9fec5639-6c60-4229-97c0-d6a37360dbc1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:00.049385 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9fec5639-6c60-4229-97c0-d6a37360dbc1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:00.049809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9fec5639-6c60-4229-97c0-d6a37360dbc1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:00.050220 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9fec5639-6c60-4229-97c0-d6a37360dbc1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:00.097213 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d0faf7b5-8836-4830-88e1-71119d779ee7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:00.105389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d0faf7b5-8836-4830-88e1-71119d779ee7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.169831 Oct 04 08:54:00.106047 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 139/297] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:59 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:00.113671 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9fec5639-6c60-4229-97c0-d6a37360dbc1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:00.122013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-9fec5639-6c60-4229-97c0-d6a37360dbc1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1295 microversion: 2.1 time: 0.084913 Oct 04 08:54:00.122606 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 159/298] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:00 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:01.135166 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ee120f1d-9614-4965-85cd-c8d80618ea9d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:01.135972 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ee120f1d-9614-4965-85cd-c8d80618ea9d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:01.144088 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ee120f1d-9614-4965-85cd-c8d80618ea9d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:01.144892 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ee120f1d-9614-4965-85cd-c8d80618ea9d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:01.145291 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c942a6f7-cf91-452a-90a0-2f607bd5cb41 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:01.145886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ee120f1d-9614-4965-85cd-c8d80618ea9d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:01.146541 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c942a6f7-cf91-452a-90a0-2f607bd5cb41 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:01.146689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ee120f1d-9614-4965-85cd-c8d80618ea9d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:01.147781 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ee120f1d-9614-4965-85cd-c8d80618ea9d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:01.148563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ee120f1d-9614-4965-85cd-c8d80618ea9d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:01.155918 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c942a6f7-cf91-452a-90a0-2f607bd5cb41 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:01.156915 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c942a6f7-cf91-452a-90a0-2f607bd5cb41 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:01.159477 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c942a6f7-cf91-452a-90a0-2f607bd5cb41 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:01.160442 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c942a6f7-cf91-452a-90a0-2f607bd5cb41 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:01.161269 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c942a6f7-cf91-452a-90a0-2f607bd5cb41 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:01.162614 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c942a6f7-cf91-452a-90a0-2f607bd5cb41 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:01.696337 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c942a6f7-cf91-452a-90a0-2f607bd5cb41 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:01.698377 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ee120f1d-9614-4965-85cd-c8d80618ea9d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:01.706043 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c942a6f7-cf91-452a-90a0-2f607bd5cb41 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.565259 Oct 04 08:54:01.706616 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 160/299] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:01 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:01.721196 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ee120f1d-9614-4965-85cd-c8d80618ea9d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1521 microversion: 2.1 time: 0.590001 Oct 04 08:54:01.722978 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 140/300] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:01 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1521 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:02.260897 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-ba548c17-c3cd-4d6f-8c98-376a89e0a772 req-e1816336-317c-4df7-b719-1e1712f43d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86725d76-c18e-4df2-94ff-93d73b5bc65f", "tag": "da852373-b7f7-4d27-921e-8fabd651eaa5"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:02.290579 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-ba548c17-c3cd-4d6f-8c98-376a89e0a772 req-e1816336-317c-4df7-b719-1e1712f43d9e service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:02.291051 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-ba548c17-c3cd-4d6f-8c98-376a89e0a772 req-e1816336-317c-4df7-b719-1e1712f43d9e service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:02.291465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-ba548c17-c3cd-4d6f-8c98-376a89e0a772 req-e1816336-317c-4df7-b719-1e1712f43d9e service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:02.309307 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-ba548c17-c3cd-4d6f-8c98-376a89e0a772 req-e1816336-317c-4df7-b719-1e1712f43d9e service nova] Creating event network-changed:da852373-b7f7-4d27-921e-8fabd651eaa5 for instance 86725d76-c18e-4df2-94ff-93d73b5bc65f on hv-cinder-84456 Oct 04 08:54:02.315178 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-ba548c17-c3cd-4d6f-8c98-376a89e0a772 req-e1816336-317c-4df7-b719-1e1712f43d9e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075427 Oct 04 08:54:02.315797 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 161/301] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:02.732376 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-65ef1a80-175e-481f-a149-b84dd01b5de7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:02.733237 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-65ef1a80-175e-481f-a149-b84dd01b5de7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:02.740756 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-65ef1a80-175e-481f-a149-b84dd01b5de7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:02.741439 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-65ef1a80-175e-481f-a149-b84dd01b5de7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:02.747185 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2e657697-8cbb-41ab-8f16-66b4813a5377 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:02.748139 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2e657697-8cbb-41ab-8f16-66b4813a5377 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:02.752547 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-65ef1a80-175e-481f-a149-b84dd01b5de7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:02.753930 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-65ef1a80-175e-481f-a149-b84dd01b5de7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:02.755843 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-65ef1a80-175e-481f-a149-b84dd01b5de7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:02.756664 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-65ef1a80-175e-481f-a149-b84dd01b5de7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:02.760247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2e657697-8cbb-41ab-8f16-66b4813a5377 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:02.761073 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2e657697-8cbb-41ab-8f16-66b4813a5377 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:02.762909 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2e657697-8cbb-41ab-8f16-66b4813a5377 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:02.764630 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2e657697-8cbb-41ab-8f16-66b4813a5377 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:02.765344 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2e657697-8cbb-41ab-8f16-66b4813a5377 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:02.767290 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2e657697-8cbb-41ab-8f16-66b4813a5377 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:03.083069 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2e657697-8cbb-41ab-8f16-66b4813a5377 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:03.094813 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-65ef1a80-175e-481f-a149-b84dd01b5de7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:03.094990 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2e657697-8cbb-41ab-8f16-66b4813a5377 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1501 microversion: 2.1 time: 0.351889 Oct 04 08:54:03.095630 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 162/302] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:02 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1501 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:03.114007 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-65ef1a80-175e-481f-a149-b84dd01b5de7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.386605 Oct 04 08:54:03.118306 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a399ed67-bac9-4898-9651-553895cff34c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:03.118917 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a399ed67-bac9-4898-9651-553895cff34c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:03.124924 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a399ed67-bac9-4898-9651-553895cff34c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:03.125397 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 141/303] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:02 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:03.125831 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a399ed67-bac9-4898-9651-553895cff34c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:03.126264 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a399ed67-bac9-4898-9651-553895cff34c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:03.126952 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a399ed67-bac9-4898-9651-553895cff34c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:03.127400 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a399ed67-bac9-4898-9651-553895cff34c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:03.127985 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a399ed67-bac9-4898-9651-553895cff34c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:03.264618 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-a399ed67-bac9-4898-9651-553895cff34c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:03.275138 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a399ed67-bac9-4898-9651-553895cff34c tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1516 microversion: 2.1 time: 0.160801 Oct 04 08:54:03.276329 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 163/304] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:03 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:04.137802 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-50be2cfd-aab0-4c04-84fc-938c0a3f35b8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:04.138474 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-50be2cfd-aab0-4c04-84fc-938c0a3f35b8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:04.145904 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-50be2cfd-aab0-4c04-84fc-938c0a3f35b8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:04.146389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-50be2cfd-aab0-4c04-84fc-938c0a3f35b8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:04.146863 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-50be2cfd-aab0-4c04-84fc-938c0a3f35b8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:04.147558 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-50be2cfd-aab0-4c04-84fc-938c0a3f35b8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:04.148060 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-50be2cfd-aab0-4c04-84fc-938c0a3f35b8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:04.148482 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-50be2cfd-aab0-4c04-84fc-938c0a3f35b8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:04.309749 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-50be2cfd-aab0-4c04-84fc-938c0a3f35b8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:04.318039 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-50be2cfd-aab0-4c04-84fc-938c0a3f35b8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.184542 Oct 04 08:54:04.318925 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 142/305] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:04 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:04.753446 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5b7d78b2-8819-4593-a86c-a8082e7a2dbc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:04.755759 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5b7d78b2-8819-4593-a86c-a8082e7a2dbc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:04.761803 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5b7d78b2-8819-4593-a86c-a8082e7a2dbc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:04.762283 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5b7d78b2-8819-4593-a86c-a8082e7a2dbc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:04.762710 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5b7d78b2-8819-4593-a86c-a8082e7a2dbc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:04.763403 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5b7d78b2-8819-4593-a86c-a8082e7a2dbc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:04.763846 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5b7d78b2-8819-4593-a86c-a8082e7a2dbc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:04.764294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5b7d78b2-8819-4593-a86c-a8082e7a2dbc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:04.787564 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-5b7d78b2-8819-4593-a86c-a8082e7a2dbc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lazy-loading 'flavor' on Instance uuid d28f0369-796d-4b75-b047-ccf9a6998560 {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:54:04.864703 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5b7d78b2-8819-4593-a86c-a8082e7a2dbc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "POST /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560/action" status: 200 len: 32 microversion: 2.1 time: 0.115167 Oct 04 08:54:04.865269 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 164/306] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Oct 4 08:54:04 2022] POST /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560/action => generated 32 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:54:04.877200 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-44bf02a5-d395-40b6-9924-999192452e86 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:04.877832 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-44bf02a5-d395-40b6-9924-999192452e86 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:04.886503 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-44bf02a5-d395-40b6-9924-999192452e86 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:04.887438 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-44bf02a5-d395-40b6-9924-999192452e86 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:04.887876 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-44bf02a5-d395-40b6-9924-999192452e86 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:04.888681 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-44bf02a5-d395-40b6-9924-999192452e86 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:04.889180 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-44bf02a5-d395-40b6-9924-999192452e86 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:04.889655 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-44bf02a5-d395-40b6-9924-999192452e86 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:05.106435 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-44bf02a5-d395-40b6-9924-999192452e86 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:05.115265 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-44bf02a5-d395-40b6-9924-999192452e86 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.242115 Oct 04 08:54:05.115986 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 143/307] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:04 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:05.342018 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c5fb6444-504e-4609-9548-7f2fc116caa7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:05.343261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c5fb6444-504e-4609-9548-7f2fc116caa7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:05.351107 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c5fb6444-504e-4609-9548-7f2fc116caa7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:05.351580 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c5fb6444-504e-4609-9548-7f2fc116caa7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:05.352131 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c5fb6444-504e-4609-9548-7f2fc116caa7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:05.352844 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c5fb6444-504e-4609-9548-7f2fc116caa7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:05.353437 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c5fb6444-504e-4609-9548-7f2fc116caa7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:05.353848 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c5fb6444-504e-4609-9548-7f2fc116caa7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:05.505476 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c5fb6444-504e-4609-9548-7f2fc116caa7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:05.514478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c5fb6444-504e-4609-9548-7f2fc116caa7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.176875 Oct 04 08:54:05.515006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 165/308] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:05 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:06.138075 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-07b23162-49e9-467c-a378-7458da76abb3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:06.138764 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-07b23162-49e9-467c-a378-7458da76abb3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:06.145181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-07b23162-49e9-467c-a378-7458da76abb3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:06.145731 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-07b23162-49e9-467c-a378-7458da76abb3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:06.146274 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-07b23162-49e9-467c-a378-7458da76abb3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:06.147148 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-07b23162-49e9-467c-a378-7458da76abb3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:06.147663 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-07b23162-49e9-467c-a378-7458da76abb3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:06.148267 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-07b23162-49e9-467c-a378-7458da76abb3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:06.305065 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-07b23162-49e9-467c-a378-7458da76abb3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:06.312934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-07b23162-49e9-467c-a378-7458da76abb3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.178655 Oct 04 08:54:06.313439 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 144/309] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:06 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:06.544041 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a60b0c9b-87a6-4fbc-8526-95165331196b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:06.545118 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a60b0c9b-87a6-4fbc-8526-95165331196b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:06.555165 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a60b0c9b-87a6-4fbc-8526-95165331196b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:06.555973 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a60b0c9b-87a6-4fbc-8526-95165331196b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:06.556738 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a60b0c9b-87a6-4fbc-8526-95165331196b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:06.557878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a60b0c9b-87a6-4fbc-8526-95165331196b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:06.558626 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a60b0c9b-87a6-4fbc-8526-95165331196b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:06.559325 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a60b0c9b-87a6-4fbc-8526-95165331196b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:06.702120 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-a60b0c9b-87a6-4fbc-8526-95165331196b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:06.705713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:06.710928 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a60b0c9b-87a6-4fbc-8526-95165331196b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.173686 Oct 04 08:54:06.711497 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 166/310] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:06 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:07.336545 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1999404c-92c8-4f8b-9694-6611d17b7bda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:07.337152 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1999404c-92c8-4f8b-9694-6611d17b7bda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:07.343975 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1999404c-92c8-4f8b-9694-6611d17b7bda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:07.344465 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1999404c-92c8-4f8b-9694-6611d17b7bda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:07.344931 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1999404c-92c8-4f8b-9694-6611d17b7bda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:07.345626 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1999404c-92c8-4f8b-9694-6611d17b7bda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:07.346077 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1999404c-92c8-4f8b-9694-6611d17b7bda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:07.346502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1999404c-92c8-4f8b-9694-6611d17b7bda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:07.476416 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1999404c-92c8-4f8b-9694-6611d17b7bda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:07.484888 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1999404c-92c8-4f8b-9694-6611d17b7bda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.152310 Oct 04 08:54:07.485461 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 145/311] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:07 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:07.738392 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2af2fdeb-91ea-4706-83bd-a88a692a8e83 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:07.739360 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2af2fdeb-91ea-4706-83bd-a88a692a8e83 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:07.749788 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2af2fdeb-91ea-4706-83bd-a88a692a8e83 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:07.750544 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2af2fdeb-91ea-4706-83bd-a88a692a8e83 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:07.751247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2af2fdeb-91ea-4706-83bd-a88a692a8e83 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:07.752336 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2af2fdeb-91ea-4706-83bd-a88a692a8e83 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:07.753004 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2af2fdeb-91ea-4706-83bd-a88a692a8e83 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:07.753615 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2af2fdeb-91ea-4706-83bd-a88a692a8e83 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:07.889247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2af2fdeb-91ea-4706-83bd-a88a692a8e83 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:07.897595 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2af2fdeb-91ea-4706-83bd-a88a692a8e83 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.166606 Oct 04 08:54:07.898157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 167/312] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:07 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:08.512592 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ac3dd108-ee02-4666-a70e-71baffcead14 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:08.513481 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ac3dd108-ee02-4666-a70e-71baffcead14 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:08.524752 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ac3dd108-ee02-4666-a70e-71baffcead14 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:08.525726 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ac3dd108-ee02-4666-a70e-71baffcead14 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:08.526463 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ac3dd108-ee02-4666-a70e-71baffcead14 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:08.527615 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ac3dd108-ee02-4666-a70e-71baffcead14 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:08.528429 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ac3dd108-ee02-4666-a70e-71baffcead14 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:08.529148 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ac3dd108-ee02-4666-a70e-71baffcead14 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:08.671758 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ac3dd108-ee02-4666-a70e-71baffcead14 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:08.683878 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ac3dd108-ee02-4666-a70e-71baffcead14 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.177668 Oct 04 08:54:08.684697 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 146/313] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:08 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:08.920584 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-896e5dc6-c344-44e1-ad18-9dc62d5e7fc6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:08.921189 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-896e5dc6-c344-44e1-ad18-9dc62d5e7fc6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:08.927427 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-896e5dc6-c344-44e1-ad18-9dc62d5e7fc6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:08.927912 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-896e5dc6-c344-44e1-ad18-9dc62d5e7fc6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:08.928413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-896e5dc6-c344-44e1-ad18-9dc62d5e7fc6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:08.929109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-896e5dc6-c344-44e1-ad18-9dc62d5e7fc6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:08.929559 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-896e5dc6-c344-44e1-ad18-9dc62d5e7fc6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:08.929983 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-896e5dc6-c344-44e1-ad18-9dc62d5e7fc6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:09.057756 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-896e5dc6-c344-44e1-ad18-9dc62d5e7fc6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:09.065775 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-896e5dc6-c344-44e1-ad18-9dc62d5e7fc6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.149042 Oct 04 08:54:09.066319 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 168/314] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:08 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:09.707424 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-32d73020-d252-4979-bc95-24fa125d9681 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:09.708179 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-32d73020-d252-4979-bc95-24fa125d9681 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:09.715150 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32d73020-d252-4979-bc95-24fa125d9681 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:09.715633 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32d73020-d252-4979-bc95-24fa125d9681 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:09.716106 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32d73020-d252-4979-bc95-24fa125d9681 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:09.716792 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32d73020-d252-4979-bc95-24fa125d9681 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:09.717243 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32d73020-d252-4979-bc95-24fa125d9681 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:09.717659 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32d73020-d252-4979-bc95-24fa125d9681 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:09.858227 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-32d73020-d252-4979-bc95-24fa125d9681 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:09.869016 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-32d73020-d252-4979-bc95-24fa125d9681 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.165904 Oct 04 08:54:09.869551 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 147/315] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:09 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:10.091876 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-3c90c9c1-872b-47ae-a521-17845b1a5f70 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:10.093049 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-3c90c9c1-872b-47ae-a521-17845b1a5f70 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:10.101996 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c90c9c1-872b-47ae-a521-17845b1a5f70 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:10.102471 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c90c9c1-872b-47ae-a521-17845b1a5f70 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:10.102892 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c90c9c1-872b-47ae-a521-17845b1a5f70 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:10.103575 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c90c9c1-872b-47ae-a521-17845b1a5f70 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:10.104046 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c90c9c1-872b-47ae-a521-17845b1a5f70 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:10.104448 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c90c9c1-872b-47ae-a521-17845b1a5f70 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:10.241465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3c90c9c1-872b-47ae-a521-17845b1a5f70 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:10.249704 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-3c90c9c1-872b-47ae-a521-17845b1a5f70 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.164243 Oct 04 08:54:10.250266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 169/316] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:10 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:10.892733 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-cf761580-6353-4501-9e0e-54669f9e20c6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:10.893540 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-cf761580-6353-4501-9e0e-54669f9e20c6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:10.901561 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cf761580-6353-4501-9e0e-54669f9e20c6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:10.902070 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cf761580-6353-4501-9e0e-54669f9e20c6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:10.902542 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cf761580-6353-4501-9e0e-54669f9e20c6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:10.903312 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cf761580-6353-4501-9e0e-54669f9e20c6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:10.903772 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cf761580-6353-4501-9e0e-54669f9e20c6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:10.904224 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cf761580-6353-4501-9e0e-54669f9e20c6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:11.041400 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-cf761580-6353-4501-9e0e-54669f9e20c6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:11.049523 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-cf761580-6353-4501-9e0e-54669f9e20c6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.160711 Oct 04 08:54:11.050095 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 148/317] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:10 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:11.274492 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4bbff18c-10df-4679-b827-64c8abbfd8f2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:11.275094 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4bbff18c-10df-4679-b827-64c8abbfd8f2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:11.281509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4bbff18c-10df-4679-b827-64c8abbfd8f2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:11.281989 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4bbff18c-10df-4679-b827-64c8abbfd8f2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:11.282415 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4bbff18c-10df-4679-b827-64c8abbfd8f2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:11.283098 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4bbff18c-10df-4679-b827-64c8abbfd8f2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:11.283543 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4bbff18c-10df-4679-b827-64c8abbfd8f2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:11.283993 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4bbff18c-10df-4679-b827-64c8abbfd8f2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:11.418282 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4bbff18c-10df-4679-b827-64c8abbfd8f2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:11.425909 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4bbff18c-10df-4679-b827-64c8abbfd8f2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.157228 Oct 04 08:54:11.437234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 170/318] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:11 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:11.572431 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-460567355", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "networks": [{"uuid": "48ab57a6-62ab-4290-9ed2-13729cd553a5"}]}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:12.074246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f45d4cc6-0657-4bde-b11b-6805a3b959b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:12.074772 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f45d4cc6-0657-4bde-b11b-6805a3b959b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:12.081399 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f45d4cc6-0657-4bde-b11b-6805a3b959b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:12.081889 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f45d4cc6-0657-4bde-b11b-6805a3b959b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:12.082325 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f45d4cc6-0657-4bde-b11b-6805a3b959b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:12.083015 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f45d4cc6-0657-4bde-b11b-6805a3b959b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:12.083500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f45d4cc6-0657-4bde-b11b-6805a3b959b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:12.083912 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f45d4cc6-0657-4bde-b11b-6805a3b959b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:12.219787 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f45d4cc6-0657-4bde-b11b-6805a3b959b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:12.228323 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f45d4cc6-0657-4bde-b11b-6805a3b959b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.158159 Oct 04 08:54:12.228914 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 171/319] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:12 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:12.448015 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-109f0aa5-ea78-4c42-90b4-219974589048 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:12.448785 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-109f0aa5-ea78-4c42-90b4-219974589048 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:12.455101 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-109f0aa5-ea78-4c42-90b4-219974589048 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:12.455682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-109f0aa5-ea78-4c42-90b4-219974589048 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:12.456187 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-109f0aa5-ea78-4c42-90b4-219974589048 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:12.456880 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-109f0aa5-ea78-4c42-90b4-219974589048 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:12.457578 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-109f0aa5-ea78-4c42-90b4-219974589048 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:12.457932 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-109f0aa5-ea78-4c42-90b4-219974589048 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:12.593068 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-109f0aa5-ea78-4c42-90b4-219974589048 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:12.600833 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-109f0aa5-ea78-4c42-90b4-219974589048 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.156862 Oct 04 08:54:12.601460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 172/320] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:12 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:13.256467 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2648168f-08da-4a1f-ac1a-beeed9b64b7a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:13.257554 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2648168f-08da-4a1f-ac1a-beeed9b64b7a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:13.267811 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2648168f-08da-4a1f-ac1a-beeed9b64b7a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:13.268667 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2648168f-08da-4a1f-ac1a-beeed9b64b7a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:13.269409 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2648168f-08da-4a1f-ac1a-beeed9b64b7a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:13.270506 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2648168f-08da-4a1f-ac1a-beeed9b64b7a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:13.271247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2648168f-08da-4a1f-ac1a-beeed9b64b7a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:13.277460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2648168f-08da-4a1f-ac1a-beeed9b64b7a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:13.408097 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2648168f-08da-4a1f-ac1a-beeed9b64b7a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:13.415991 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2648168f-08da-4a1f-ac1a-beeed9b64b7a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.166707 Oct 04 08:54:13.416612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 173/321] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:13 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:13.628289 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8846bec0-1aea-409e-a971-0815594148b5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:13.629307 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8846bec0-1aea-409e-a971-0815594148b5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:13.637927 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8846bec0-1aea-409e-a971-0815594148b5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:13.638336 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8846bec0-1aea-409e-a971-0815594148b5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:13.638754 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8846bec0-1aea-409e-a971-0815594148b5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:13.639431 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8846bec0-1aea-409e-a971-0815594148b5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:13.639870 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8846bec0-1aea-409e-a971-0815594148b5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:13.640385 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8846bec0-1aea-409e-a971-0815594148b5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:13.771738 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8846bec0-1aea-409e-a971-0815594148b5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:13.779596 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8846bec0-1aea-409e-a971-0815594148b5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.157789 Oct 04 08:54:13.780196 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 174/322] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:13 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:14.442464 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-3c7c9efe-bee9-41f5-a974-7a6a78609c25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:14.443205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-3c7c9efe-bee9-41f5-a974-7a6a78609c25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:14.445955 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=62 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:14.452118 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c7c9efe-bee9-41f5-a974-7a6a78609c25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:14.452590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c7c9efe-bee9-41f5-a974-7a6a78609c25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:14.453063 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c7c9efe-bee9-41f5-a974-7a6a78609c25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:14.453741 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c7c9efe-bee9-41f5-a974-7a6a78609c25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:14.454181 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c7c9efe-bee9-41f5-a974-7a6a78609c25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:14.454587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3c7c9efe-bee9-41f5-a974-7a6a78609c25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:14.609103 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3c7c9efe-bee9-41f5-a974-7a6a78609c25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:14.619453 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-3c7c9efe-bee9-41f5-a974-7a6a78609c25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.183067 Oct 04 08:54:14.620401 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 175/323] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:14 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:14.810245 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a34b2a56-0ec3-4a5a-9ebd-b7961424c7c1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:14.810901 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a34b2a56-0ec3-4a5a-9ebd-b7961424c7c1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:14.817110 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a34b2a56-0ec3-4a5a-9ebd-b7961424c7c1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:14.817596 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a34b2a56-0ec3-4a5a-9ebd-b7961424c7c1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:14.818033 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a34b2a56-0ec3-4a5a-9ebd-b7961424c7c1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:14.818727 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a34b2a56-0ec3-4a5a-9ebd-b7961424c7c1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:14.819183 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a34b2a56-0ec3-4a5a-9ebd-b7961424c7c1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:14.819602 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a34b2a56-0ec3-4a5a-9ebd-b7961424c7c1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:14.979482 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-a34b2a56-0ec3-4a5a-9ebd-b7961424c7c1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:14.989432 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a34b2a56-0ec3-4a5a-9ebd-b7961424c7c1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.185555 Oct 04 08:54:14.990234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 176/324] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:14 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:15.647377 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-da3a8efd-7d8b-4bd0-a618-a9d63b7c87bf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:15.648212 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-da3a8efd-7d8b-4bd0-a618-a9d63b7c87bf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:15.656080 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-da3a8efd-7d8b-4bd0-a618-a9d63b7c87bf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:15.656656 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-da3a8efd-7d8b-4bd0-a618-a9d63b7c87bf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:15.657261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-da3a8efd-7d8b-4bd0-a618-a9d63b7c87bf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:15.657960 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-da3a8efd-7d8b-4bd0-a618-a9d63b7c87bf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:15.658403 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-da3a8efd-7d8b-4bd0-a618-a9d63b7c87bf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:15.658815 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-da3a8efd-7d8b-4bd0-a618-a9d63b7c87bf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:15.795486 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-da3a8efd-7d8b-4bd0-a618-a9d63b7c87bf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:15.803904 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-da3a8efd-7d8b-4bd0-a618-a9d63b7c87bf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.164707 Oct 04 08:54:15.804484 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 177/325] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:15 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:16.013237 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-27395ac9-40cf-4b11-b1d9-1c76968dc425 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:16.014171 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-27395ac9-40cf-4b11-b1d9-1c76968dc425 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:16.021116 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27395ac9-40cf-4b11-b1d9-1c76968dc425 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:16.021759 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27395ac9-40cf-4b11-b1d9-1c76968dc425 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:16.022278 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27395ac9-40cf-4b11-b1d9-1c76968dc425 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:16.023047 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27395ac9-40cf-4b11-b1d9-1c76968dc425 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:16.023676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27395ac9-40cf-4b11-b1d9-1c76968dc425 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:16.024097 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27395ac9-40cf-4b11-b1d9-1c76968dc425 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:16.185346 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-27395ac9-40cf-4b11-b1d9-1c76968dc425 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:16.194202 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-27395ac9-40cf-4b11-b1d9-1c76968dc425 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.185537 Oct 04 08:54:16.194765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 178/326] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:16 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:16.828260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-745d2e90-c4a1-4ff3-b9b3-2e84a025aaac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:16.828867 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-745d2e90-c4a1-4ff3-b9b3-2e84a025aaac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:16.835309 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-745d2e90-c4a1-4ff3-b9b3-2e84a025aaac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:16.835793 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-745d2e90-c4a1-4ff3-b9b3-2e84a025aaac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:16.836331 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-745d2e90-c4a1-4ff3-b9b3-2e84a025aaac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:16.837025 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-745d2e90-c4a1-4ff3-b9b3-2e84a025aaac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:16.837475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-745d2e90-c4a1-4ff3-b9b3-2e84a025aaac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:16.837894 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-745d2e90-c4a1-4ff3-b9b3-2e84a025aaac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:16.981583 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-745d2e90-c4a1-4ff3-b9b3-2e84a025aaac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:16.989666 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-745d2e90-c4a1-4ff3-b9b3-2e84a025aaac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.166722 Oct 04 08:54:16.990233 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 179/327] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:16 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:17.216773 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-bc7c4e63-164f-4afa-a275-3ebd5d39a7b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:17.217387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-bc7c4e63-164f-4afa-a275-3ebd5d39a7b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:17.224595 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc7c4e63-164f-4afa-a275-3ebd5d39a7b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:17.225076 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc7c4e63-164f-4afa-a275-3ebd5d39a7b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:17.225487 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc7c4e63-164f-4afa-a275-3ebd5d39a7b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:17.226465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc7c4e63-164f-4afa-a275-3ebd5d39a7b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:17.227065 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc7c4e63-164f-4afa-a275-3ebd5d39a7b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:17.227488 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc7c4e63-164f-4afa-a275-3ebd5d39a7b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:17.373942 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-bc7c4e63-164f-4afa-a275-3ebd5d39a7b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:17.384540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-bc7c4e63-164f-4afa-a275-3ebd5d39a7b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.171540 Oct 04 08:54:17.385068 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 180/328] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:17 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:18.013744 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-99a39bdb-98b8-4276-a196-67faedcaef1a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:18.014786 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-99a39bdb-98b8-4276-a196-67faedcaef1a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:18.021927 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-99a39bdb-98b8-4276-a196-67faedcaef1a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:18.023122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-99a39bdb-98b8-4276-a196-67faedcaef1a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:18.023549 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-99a39bdb-98b8-4276-a196-67faedcaef1a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:18.024622 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-99a39bdb-98b8-4276-a196-67faedcaef1a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:18.025282 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-99a39bdb-98b8-4276-a196-67faedcaef1a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:18.025766 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-99a39bdb-98b8-4276-a196-67faedcaef1a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:18.161295 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-99a39bdb-98b8-4276-a196-67faedcaef1a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:18.169405 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-99a39bdb-98b8-4276-a196-67faedcaef1a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.160246 Oct 04 08:54:18.170019 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 181/329] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:18 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:18.411849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b557c8e0-3dbc-421c-8554-c92ffe9ef43f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:18.413082 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b557c8e0-3dbc-421c-8554-c92ffe9ef43f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:18.421792 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b557c8e0-3dbc-421c-8554-c92ffe9ef43f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:18.422731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b557c8e0-3dbc-421c-8554-c92ffe9ef43f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:18.422731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b557c8e0-3dbc-421c-8554-c92ffe9ef43f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:18.425237 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b557c8e0-3dbc-421c-8554-c92ffe9ef43f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:18.425758 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b557c8e0-3dbc-421c-8554-c92ffe9ef43f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:18.426992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b557c8e0-3dbc-421c-8554-c92ffe9ef43f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:18.553556 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b557c8e0-3dbc-421c-8554-c92ffe9ef43f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:18.561688 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b557c8e0-3dbc-421c-8554-c92ffe9ef43f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.157229 Oct 04 08:54:18.562258 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 182/330] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:18 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:19.195071 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4472053d-dea4-4908-b693-15abc2f991a7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:19.195584 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4472053d-dea4-4908-b693-15abc2f991a7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:19.201976 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4472053d-dea4-4908-b693-15abc2f991a7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:19.202461 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4472053d-dea4-4908-b693-15abc2f991a7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:19.202890 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4472053d-dea4-4908-b693-15abc2f991a7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:19.203563 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4472053d-dea4-4908-b693-15abc2f991a7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:19.204062 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4472053d-dea4-4908-b693-15abc2f991a7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:19.204482 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4472053d-dea4-4908-b693-15abc2f991a7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:19.222555 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=100 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:19.338372 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4472053d-dea4-4908-b693-15abc2f991a7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:19.346484 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4472053d-dea4-4908-b693-15abc2f991a7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.155463 Oct 04 08:54:19.347303 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 183/331] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:19 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:19.584709 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8b80ab34-850f-4943-9362-e4c12b047760 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:19.585480 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8b80ab34-850f-4943-9362-e4c12b047760 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:19.591368 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8b80ab34-850f-4943-9362-e4c12b047760 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:19.591919 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8b80ab34-850f-4943-9362-e4c12b047760 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:19.592369 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8b80ab34-850f-4943-9362-e4c12b047760 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:19.593063 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8b80ab34-850f-4943-9362-e4c12b047760 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:19.593506 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8b80ab34-850f-4943-9362-e4c12b047760 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:19.594013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8b80ab34-850f-4943-9362-e4c12b047760 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:19.731921 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8b80ab34-850f-4943-9362-e4c12b047760 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:19.740602 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8b80ab34-850f-4943-9362-e4c12b047760 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.159734 Oct 04 08:54:19.741169 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 184/332] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:19 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:20.104359 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.network.neutron [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] validate_networks() for [('48ab57a6-62ab-4290-9ed2-13729cd553a5', None, None, None, None, None)] {{(pid=142439) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:54:20.371143 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-bcf31701-7f14-445b-b0d7-f7389844a5be tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:20.372071 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-bcf31701-7f14-445b-b0d7-f7389844a5be tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:20.378492 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bcf31701-7f14-445b-b0d7-f7389844a5be tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:20.379218 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bcf31701-7f14-445b-b0d7-f7389844a5be tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:20.379847 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bcf31701-7f14-445b-b0d7-f7389844a5be tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:20.381079 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bcf31701-7f14-445b-b0d7-f7389844a5be tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:20.381079 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bcf31701-7f14-445b-b0d7-f7389844a5be tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:20.386970 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bcf31701-7f14-445b-b0d7-f7389844a5be tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:20.521380 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Flavor limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:54:20.521798 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Image limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:54:20.522295 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Flavor pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:54:20.522698 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Image pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:54:20.523133 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:54:20.532200 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:20.532680 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:20.533110 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:20.533825 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:20.534269 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:20.534745 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:20.543443 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=100 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:20.547203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-bcf31701-7f14-445b-b0d7-f7389844a5be tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:20.553580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Getting quotas for project 67b474ba7f7a465caa2ed14f891ac951. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:54:20.556478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-bcf31701-7f14-445b-b0d7-f7389844a5be tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.190516 Oct 04 08:54:20.557537 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 185/333] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:20 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:20.560123 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Getting quotas for user 1e44ee032c5346ec9260740bcb700007 and project 67b474ba7f7a465caa2ed14f891ac951. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:54:20.571903 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Going to run 1 instances... {{(pid=142439) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:54:20.574098 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:54:20.620188 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5bf0d5fe-2e9a-46f5-8c02-4cabc1657401 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.051591 Oct 04 08:54:20.620831 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 149/334] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 08:54:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 9053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:54:20.631972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1fa70d4a-ea7f-48fc-89f2-bbcf3593328e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:20.632732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1fa70d4a-ea7f-48fc-89f2-bbcf3593328e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:20.684867 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1fa70d4a-ea7f-48fc-89f2-bbcf3593328e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:20.691702 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1fa70d4a-ea7f-48fc-89f2-bbcf3593328e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1218 microversion: 2.1 time: 0.063714 Oct 04 08:54:20.692303 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 186/335] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:20 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:20.762501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e9ad253b-550b-4928-aea1-e7e30d9705e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:20.763110 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e9ad253b-550b-4928-aea1-e7e30d9705e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:20.769341 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e9ad253b-550b-4928-aea1-e7e30d9705e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:20.770134 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e9ad253b-550b-4928-aea1-e7e30d9705e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:20.770594 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e9ad253b-550b-4928-aea1-e7e30d9705e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:20.771279 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e9ad253b-550b-4928-aea1-e7e30d9705e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:20.771726 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e9ad253b-550b-4928-aea1-e7e30d9705e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:20.772179 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e9ad253b-550b-4928-aea1-e7e30d9705e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:20.912904 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e9ad253b-550b-4928-aea1-e7e30d9705e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:20.922305 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e9ad253b-550b-4928-aea1-e7e30d9705e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.163615 Oct 04 08:54:20.922951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 150/336] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:20 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:21.580052 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6502a15f-3ec3-4d94-9b33-a002a327c684 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:21.580663 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6502a15f-3ec3-4d94-9b33-a002a327c684 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:21.587506 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6502a15f-3ec3-4d94-9b33-a002a327c684 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:21.588029 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6502a15f-3ec3-4d94-9b33-a002a327c684 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:21.588462 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6502a15f-3ec3-4d94-9b33-a002a327c684 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:21.589145 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6502a15f-3ec3-4d94-9b33-a002a327c684 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:21.589591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6502a15f-3ec3-4d94-9b33-a002a327c684 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:21.590004 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6502a15f-3ec3-4d94-9b33-a002a327c684 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:21.715288 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0d4d73ef-b2a9-4e8b-ad22-3d39b31026e5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:21.716204 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0d4d73ef-b2a9-4e8b-ad22-3d39b31026e5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:21.726240 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0d4d73ef-b2a9-4e8b-ad22-3d39b31026e5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:21.726796 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0d4d73ef-b2a9-4e8b-ad22-3d39b31026e5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:21.727294 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0d4d73ef-b2a9-4e8b-ad22-3d39b31026e5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:21.728105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0d4d73ef-b2a9-4e8b-ad22-3d39b31026e5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:21.728614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0d4d73ef-b2a9-4e8b-ad22-3d39b31026e5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:21.729131 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0d4d73ef-b2a9-4e8b-ad22-3d39b31026e5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:21.739915 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6502a15f-3ec3-4d94-9b33-a002a327c684 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:21.749039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6502a15f-3ec3-4d94-9b33-a002a327c684 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.172878 Oct 04 08:54:21.749856 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 187/337] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:21 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:21.790006 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0d4d73ef-b2a9-4e8b-ad22-3d39b31026e5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:21.797926 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0d4d73ef-b2a9-4e8b-ad22-3d39b31026e5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1222 microversion: 2.1 time: 0.087208 Oct 04 08:54:21.798486 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 151/338] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:21 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:21.949355 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-053cbc1c-2ac6-4eda-b1b6-185d5159aa37 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:21.949996 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-053cbc1c-2ac6-4eda-b1b6-185d5159aa37 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:21.956875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-053cbc1c-2ac6-4eda-b1b6-185d5159aa37 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:21.957355 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-053cbc1c-2ac6-4eda-b1b6-185d5159aa37 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:21.957772 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-053cbc1c-2ac6-4eda-b1b6-185d5159aa37 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:21.958458 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-053cbc1c-2ac6-4eda-b1b6-185d5159aa37 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:21.958898 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-053cbc1c-2ac6-4eda-b1b6-185d5159aa37 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:21.959305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-053cbc1c-2ac6-4eda-b1b6-185d5159aa37 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:22.095088 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-053cbc1c-2ac6-4eda-b1b6-185d5159aa37 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:22.103098 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-053cbc1c-2ac6-4eda-b1b6-185d5159aa37 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.158057 Oct 04 08:54:22.103670 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 188/339] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:21 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:22.773136 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-be238792-f238-4002-a054-d781a23bb320 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:22.773706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-be238792-f238-4002-a054-d781a23bb320 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:22.780821 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be238792-f238-4002-a054-d781a23bb320 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:22.781290 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be238792-f238-4002-a054-d781a23bb320 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:22.781755 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be238792-f238-4002-a054-d781a23bb320 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:22.782448 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be238792-f238-4002-a054-d781a23bb320 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:22.782940 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be238792-f238-4002-a054-d781a23bb320 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:22.783348 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be238792-f238-4002-a054-d781a23bb320 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:22.828866 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9f24441d-dda1-4d42-8eb3-9c2523a4b8f3 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:22.829707 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9f24441d-dda1-4d42-8eb3-9c2523a4b8f3 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:22.836471 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9f24441d-dda1-4d42-8eb3-9c2523a4b8f3 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:22.837044 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9f24441d-dda1-4d42-8eb3-9c2523a4b8f3 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:22.837535 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9f24441d-dda1-4d42-8eb3-9c2523a4b8f3 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:22.838293 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9f24441d-dda1-4d42-8eb3-9c2523a4b8f3 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:22.838780 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9f24441d-dda1-4d42-8eb3-9c2523a4b8f3 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:22.839199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9f24441d-dda1-4d42-8eb3-9c2523a4b8f3 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:22.909443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9f24441d-dda1-4d42-8eb3-9c2523a4b8f3 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:22.918406 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-9f24441d-dda1-4d42-8eb3-9c2523a4b8f3 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1222 microversion: 2.1 time: 0.093162 Oct 04 08:54:22.919004 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 189/340] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:22 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:22.942030 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-be238792-f238-4002-a054-d781a23bb320 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:22.950161 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-be238792-f238-4002-a054-d781a23bb320 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.181021 Oct 04 08:54:22.950753 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 152/341] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:22 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:23.126875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ce0f791b-c9dd-4e64-91f7-33641701bd82 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:23.127470 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ce0f791b-c9dd-4e64-91f7-33641701bd82 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:23.133875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ce0f791b-c9dd-4e64-91f7-33641701bd82 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:23.134356 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ce0f791b-c9dd-4e64-91f7-33641701bd82 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:23.134777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ce0f791b-c9dd-4e64-91f7-33641701bd82 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:23.135452 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ce0f791b-c9dd-4e64-91f7-33641701bd82 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:23.135918 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ce0f791b-c9dd-4e64-91f7-33641701bd82 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:23.136333 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ce0f791b-c9dd-4e64-91f7-33641701bd82 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:23.282852 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ce0f791b-c9dd-4e64-91f7-33641701bd82 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:23.294561 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ce0f791b-c9dd-4e64-91f7-33641701bd82 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.171469 Oct 04 08:54:23.295227 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 190/342] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:23 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:23.942313 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-08fa8330-2b47-4851-9840-469f228c944e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:23.943096 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-08fa8330-2b47-4851-9840-469f228c944e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:23.954808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-08fa8330-2b47-4851-9840-469f228c944e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:23.955332 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-08fa8330-2b47-4851-9840-469f228c944e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:23.955850 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-08fa8330-2b47-4851-9840-469f228c944e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:23.956832 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-08fa8330-2b47-4851-9840-469f228c944e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:23.957336 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-08fa8330-2b47-4851-9840-469f228c944e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:23.957787 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-08fa8330-2b47-4851-9840-469f228c944e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:23.973593 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e0d094bf-0dca-430d-bb46-a22ef5f118b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:23.974903 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e0d094bf-0dca-430d-bb46-a22ef5f118b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:23.983314 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e0d094bf-0dca-430d-bb46-a22ef5f118b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:23.983796 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e0d094bf-0dca-430d-bb46-a22ef5f118b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:23.984259 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e0d094bf-0dca-430d-bb46-a22ef5f118b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:23.991271 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e0d094bf-0dca-430d-bb46-a22ef5f118b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:23.991744 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e0d094bf-0dca-430d-bb46-a22ef5f118b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:23.992205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e0d094bf-0dca-430d-bb46-a22ef5f118b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:24.021134 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-08fa8330-2b47-4851-9840-469f228c944e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:24.038499 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-08fa8330-2b47-4851-9840-469f228c944e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1222 microversion: 2.1 time: 0.092045 Oct 04 08:54:24.038499 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 153/343] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:23 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:24.122077 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e0d094bf-0dca-430d-bb46-a22ef5f118b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:24.130459 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e0d094bf-0dca-430d-bb46-a22ef5f118b5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.161211 Oct 04 08:54:24.139377 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 191/344] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:23 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:24.324923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ed5ae4c6-f7e1-4a7f-9ab3-45b4009644bc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:24.325888 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ed5ae4c6-f7e1-4a7f-9ab3-45b4009644bc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:24.332733 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ed5ae4c6-f7e1-4a7f-9ab3-45b4009644bc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:24.333234 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ed5ae4c6-f7e1-4a7f-9ab3-45b4009644bc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:24.333687 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ed5ae4c6-f7e1-4a7f-9ab3-45b4009644bc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:24.334396 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ed5ae4c6-f7e1-4a7f-9ab3-45b4009644bc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:24.334867 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ed5ae4c6-f7e1-4a7f-9ab3-45b4009644bc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:24.335303 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ed5ae4c6-f7e1-4a7f-9ab3-45b4009644bc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:24.487388 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ed5ae4c6-f7e1-4a7f-9ab3-45b4009644bc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:24.496099 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ed5ae4c6-f7e1-4a7f-9ab3-45b4009644bc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.177791 Oct 04 08:54:24.496662 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 154/345] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:24 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:25.052999 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e62d0b1d-e3b1-48c1-9a18-412001c0f1b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:25.053600 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e62d0b1d-e3b1-48c1-9a18-412001c0f1b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:25.060078 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e62d0b1d-e3b1-48c1-9a18-412001c0f1b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:25.060560 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e62d0b1d-e3b1-48c1-9a18-412001c0f1b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:25.060984 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e62d0b1d-e3b1-48c1-9a18-412001c0f1b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:25.061666 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e62d0b1d-e3b1-48c1-9a18-412001c0f1b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:25.062114 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e62d0b1d-e3b1-48c1-9a18-412001c0f1b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:25.062534 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e62d0b1d-e3b1-48c1-9a18-412001c0f1b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:25.153875 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-80948627-0b75-42b3-9cfb-e96c9def1923 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:25.154574 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-80948627-0b75-42b3-9cfb-e96c9def1923 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:25.161844 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80948627-0b75-42b3-9cfb-e96c9def1923 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:25.162326 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80948627-0b75-42b3-9cfb-e96c9def1923 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:25.162787 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80948627-0b75-42b3-9cfb-e96c9def1923 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:25.163506 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80948627-0b75-42b3-9cfb-e96c9def1923 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:25.164000 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80948627-0b75-42b3-9cfb-e96c9def1923 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:25.164430 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80948627-0b75-42b3-9cfb-e96c9def1923 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:25.275540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e62d0b1d-e3b1-48c1-9a18-412001c0f1b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:25.288524 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e62d0b1d-e3b1-48c1-9a18-412001c0f1b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1270 microversion: 2.1 time: 0.239027 Oct 04 08:54:25.289608 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 192/346] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:25 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1270 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:25.340150 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-80948627-0b75-42b3-9cfb-e96c9def1923 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:25.347795 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-80948627-0b75-42b3-9cfb-e96c9def1923 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.198092 Oct 04 08:54:25.348386 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 155/347] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:25 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:25.520098 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d348f92c-2ce2-482d-991e-5b8dd2015532 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:25.521144 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d348f92c-2ce2-482d-991e-5b8dd2015532 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:25.527710 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d348f92c-2ce2-482d-991e-5b8dd2015532 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:25.528552 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d348f92c-2ce2-482d-991e-5b8dd2015532 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:25.529308 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d348f92c-2ce2-482d-991e-5b8dd2015532 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:25.530218 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d348f92c-2ce2-482d-991e-5b8dd2015532 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:25.530872 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d348f92c-2ce2-482d-991e-5b8dd2015532 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:25.531517 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d348f92c-2ce2-482d-991e-5b8dd2015532 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:25.686669 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d348f92c-2ce2-482d-991e-5b8dd2015532 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:25.695544 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d348f92c-2ce2-482d-991e-5b8dd2015532 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.179986 Oct 04 08:54:25.696686 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 193/348] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:25 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:26.314162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2d9166e1-020c-428f-84e1-436f4482f93f tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:26.314766 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2d9166e1-020c-428f-84e1-436f4482f93f tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:26.324592 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2d9166e1-020c-428f-84e1-436f4482f93f tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.325689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2d9166e1-020c-428f-84e1-436f4482f93f tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.326243 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2d9166e1-020c-428f-84e1-436f4482f93f tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.342261 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2d9166e1-020c-428f-84e1-436f4482f93f tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.342833 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2d9166e1-020c-428f-84e1-436f4482f93f tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.343393 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2d9166e1-020c-428f-84e1-436f4482f93f tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.373872 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0d2f95a6-89f2-47bd-b35e-f5fff436cf84 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:26.374785 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0d2f95a6-89f2-47bd-b35e-f5fff436cf84 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:26.393730 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0d2f95a6-89f2-47bd-b35e-f5fff436cf84 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.394239 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0d2f95a6-89f2-47bd-b35e-f5fff436cf84 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.394665 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0d2f95a6-89f2-47bd-b35e-f5fff436cf84 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.400117 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0d2f95a6-89f2-47bd-b35e-f5fff436cf84 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.400692 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0d2f95a6-89f2-47bd-b35e-f5fff436cf84 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.401134 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0d2f95a6-89f2-47bd-b35e-f5fff436cf84 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.592909 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2d9166e1-020c-428f-84e1-436f4482f93f tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:26.601442 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2d9166e1-020c-428f-84e1-436f4482f93f tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1318 microversion: 2.1 time: 0.293577 Oct 04 08:54:26.602199 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 156/349] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:26 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:26.651272 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0d2f95a6-89f2-47bd-b35e-f5fff436cf84 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:26.665073 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0d2f95a6-89f2-47bd-b35e-f5fff436cf84 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.296849 Oct 04 08:54:26.681081 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 194/350] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:26 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:26.719995 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-3ef84ab4-7b33-4b23-a150-3b070ef80676 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:26.720631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-3ef84ab4-7b33-4b23-a150-3b070ef80676 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:26.726973 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3ef84ab4-7b33-4b23-a150-3b070ef80676 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.727477 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3ef84ab4-7b33-4b23-a150-3b070ef80676 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.728120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3ef84ab4-7b33-4b23-a150-3b070ef80676 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.728985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3ef84ab4-7b33-4b23-a150-3b070ef80676 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.729432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3ef84ab4-7b33-4b23-a150-3b070ef80676 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.729877 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3ef84ab4-7b33-4b23-a150-3b070ef80676 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.896208 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-fcff8f50-90fb-4aac-80b0-511203b18b95 req-743122df-4e52-4b3c-aeb2-d7d04c4bb4aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7814cb20-c3e8-4c17-a901-d62f4e7bc4af", "tag": "9af692a1-b931-4d82-9e18-3ab10e16c20a"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:26.906666 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-fcff8f50-90fb-4aac-80b0-511203b18b95 req-743122df-4e52-4b3c-aeb2-d7d04c4bb4aa service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.907487 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-fcff8f50-90fb-4aac-80b0-511203b18b95 req-743122df-4e52-4b3c-aeb2-d7d04c4bb4aa service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.908136 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-fcff8f50-90fb-4aac-80b0-511203b18b95 req-743122df-4e52-4b3c-aeb2-d7d04c4bb4aa service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.923213 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-fcff8f50-90fb-4aac-80b0-511203b18b95 req-743122df-4e52-4b3c-aeb2-d7d04c4bb4aa service nova] Creating event network-changed:9af692a1-b931-4d82-9e18-3ab10e16c20a for instance 7814cb20-c3e8-4c17-a901-d62f4e7bc4af on hv-cinder-84456 Oct 04 08:54:26.930026 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-fcff8f50-90fb-4aac-80b0-511203b18b95 req-743122df-4e52-4b3c-aeb2-d7d04c4bb4aa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037847 Oct 04 08:54:26.931274 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 195/351] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:26.933772 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-3ef84ab4-7b33-4b23-a150-3b070ef80676 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:26.943688 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-3ef84ab4-7b33-4b23-a150-3b070ef80676 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.228506 Oct 04 08:54:26.959324 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 157/352] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:26 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:26.989516 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-2579854b-d892-497b-b567-58620bc99f49 req-ba5aaa22-ae7d-4ed7-ad35-01f642674c6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86725d76-c18e-4df2-94ff-93d73b5bc65f", "name": "network-vif-plugged", "status": "completed", "tag": "da852373-b7f7-4d27-921e-8fabd651eaa5"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:27.004377 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-2579854b-d892-497b-b567-58620bc99f49 req-ba5aaa22-ae7d-4ed7-ad35-01f642674c6e service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:27.005013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-2579854b-d892-497b-b567-58620bc99f49 req-ba5aaa22-ae7d-4ed7-ad35-01f642674c6e service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:27.005587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-2579854b-d892-497b-b567-58620bc99f49 req-ba5aaa22-ae7d-4ed7-ad35-01f642674c6e service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:27.018096 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-2579854b-d892-497b-b567-58620bc99f49 req-ba5aaa22-ae7d-4ed7-ad35-01f642674c6e service nova] Creating event network-vif-plugged:da852373-b7f7-4d27-921e-8fabd651eaa5 for instance 86725d76-c18e-4df2-94ff-93d73b5bc65f on hv-cinder-84456 Oct 04 08:54:27.023247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-2579854b-d892-497b-b567-58620bc99f49 req-ba5aaa22-ae7d-4ed7-ad35-01f642674c6e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038630 Oct 04 08:54:27.023878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 196/353] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:27.625717 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-81274a23-4e95-4f69-9f25-1a7a01c80b6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:27.626333 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-81274a23-4e95-4f69-9f25-1a7a01c80b6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:27.633111 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-81274a23-4e95-4f69-9f25-1a7a01c80b6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:27.633599 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-81274a23-4e95-4f69-9f25-1a7a01c80b6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:27.634064 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-81274a23-4e95-4f69-9f25-1a7a01c80b6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:27.634759 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-81274a23-4e95-4f69-9f25-1a7a01c80b6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:27.635197 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-81274a23-4e95-4f69-9f25-1a7a01c80b6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:27.635619 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-81274a23-4e95-4f69-9f25-1a7a01c80b6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:27.690845 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6bdef100-8aa9-42ab-85fb-d06711952b31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:27.691625 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6bdef100-8aa9-42ab-85fb-d06711952b31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:27.698910 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6bdef100-8aa9-42ab-85fb-d06711952b31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:27.699452 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6bdef100-8aa9-42ab-85fb-d06711952b31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:27.700412 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6bdef100-8aa9-42ab-85fb-d06711952b31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:27.701409 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6bdef100-8aa9-42ab-85fb-d06711952b31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:27.702198 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6bdef100-8aa9-42ab-85fb-d06711952b31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:27.702699 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6bdef100-8aa9-42ab-85fb-d06711952b31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:27.826667 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-81274a23-4e95-4f69-9f25-1a7a01c80b6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:27.835152 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-81274a23-4e95-4f69-9f25-1a7a01c80b6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1318 microversion: 2.1 time: 0.213409 Oct 04 08:54:27.835873 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 158/354] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:27 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:27.874816 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6bdef100-8aa9-42ab-85fb-d06711952b31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:27.882695 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6bdef100-8aa9-42ab-85fb-d06711952b31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.197020 Oct 04 08:54:27.883454 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 197/355] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:27 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:27.966264 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0d49c985-961c-408c-8c40-d904bc6e019b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:27.966943 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0d49c985-961c-408c-8c40-d904bc6e019b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:27.983387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0d49c985-961c-408c-8c40-d904bc6e019b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:27.983906 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0d49c985-961c-408c-8c40-d904bc6e019b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:27.984341 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0d49c985-961c-408c-8c40-d904bc6e019b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:27.985037 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0d49c985-961c-408c-8c40-d904bc6e019b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:27.985482 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0d49c985-961c-408c-8c40-d904bc6e019b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:27.985897 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0d49c985-961c-408c-8c40-d904bc6e019b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:28.140191 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0d49c985-961c-408c-8c40-d904bc6e019b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:28.148290 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0d49c985-961c-408c-8c40-d904bc6e019b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.185759 Oct 04 08:54:28.148890 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 159/356] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:27 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:28.858699 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1fd352c6-74a7-4598-af08-30fd65efdcef tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:28.859287 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1fd352c6-74a7-4598-af08-30fd65efdcef tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:28.866129 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1fd352c6-74a7-4598-af08-30fd65efdcef tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:28.866610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1fd352c6-74a7-4598-af08-30fd65efdcef tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:28.867039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1fd352c6-74a7-4598-af08-30fd65efdcef tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:28.867727 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1fd352c6-74a7-4598-af08-30fd65efdcef tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:28.868203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1fd352c6-74a7-4598-af08-30fd65efdcef tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:28.868621 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1fd352c6-74a7-4598-af08-30fd65efdcef tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:28.905482 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-40e55654-b557-4573-b121-cb40177957e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:28.906088 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-40e55654-b557-4573-b121-cb40177957e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:28.912657 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-40e55654-b557-4573-b121-cb40177957e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:28.913135 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-40e55654-b557-4573-b121-cb40177957e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:28.913564 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-40e55654-b557-4573-b121-cb40177957e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:28.914266 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-40e55654-b557-4573-b121-cb40177957e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:28.914709 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-40e55654-b557-4573-b121-cb40177957e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:28.915121 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-40e55654-b557-4573-b121-cb40177957e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:29.039382 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1fd352c6-74a7-4598-af08-30fd65efdcef tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:29.048467 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1fd352c6-74a7-4598-af08-30fd65efdcef tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1318 microversion: 2.1 time: 0.193667 Oct 04 08:54:29.049149 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 198/357] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:28 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:29.171248 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5c0ea99a-dfeb-41c6-9ba2-5740d92b0335 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:29.171853 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5c0ea99a-dfeb-41c6-9ba2-5740d92b0335 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:29.177921 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c0ea99a-dfeb-41c6-9ba2-5740d92b0335 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:29.178400 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c0ea99a-dfeb-41c6-9ba2-5740d92b0335 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:29.178821 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c0ea99a-dfeb-41c6-9ba2-5740d92b0335 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:29.179631 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c0ea99a-dfeb-41c6-9ba2-5740d92b0335 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:29.180109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c0ea99a-dfeb-41c6-9ba2-5740d92b0335 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:29.180682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c0ea99a-dfeb-41c6-9ba2-5740d92b0335 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:29.211698 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-40e55654-b557-4573-b121-cb40177957e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:29.219673 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-40e55654-b557-4573-b121-cb40177957e1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.318404 Oct 04 08:54:29.220470 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 160/358] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:28 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:29.324729 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5c0ea99a-dfeb-41c6-9ba2-5740d92b0335 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:29.333376 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5c0ea99a-dfeb-41c6-9ba2-5740d92b0335 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.166153 Oct 04 08:54:29.333945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 199/359] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:29 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:30.071365 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-92237149-7fb7-4483-9834-7b03f7340382 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:30.071919 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-92237149-7fb7-4483-9834-7b03f7340382 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:30.075076 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:30.080952 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-92237149-7fb7-4483-9834-7b03f7340382 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:30.081435 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-92237149-7fb7-4483-9834-7b03f7340382 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:30.081860 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-92237149-7fb7-4483-9834-7b03f7340382 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:30.082531 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-92237149-7fb7-4483-9834-7b03f7340382 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:30.082988 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-92237149-7fb7-4483-9834-7b03f7340382 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:30.083406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-92237149-7fb7-4483-9834-7b03f7340382 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:30.215327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-92237149-7fb7-4483-9834-7b03f7340382 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:30.224144 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-92237149-7fb7-4483-9834-7b03f7340382 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1318 microversion: 2.1 time: 0.156634 Oct 04 08:54:30.224679 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 161/360] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:30 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:30.243356 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-41e9c04d-33a1-41ab-876d-95ae201e9224 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:30.243992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-41e9c04d-33a1-41ab-876d-95ae201e9224 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:30.250496 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41e9c04d-33a1-41ab-876d-95ae201e9224 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:30.251003 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41e9c04d-33a1-41ab-876d-95ae201e9224 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:30.251472 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41e9c04d-33a1-41ab-876d-95ae201e9224 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:30.252295 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41e9c04d-33a1-41ab-876d-95ae201e9224 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:30.252734 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41e9c04d-33a1-41ab-876d-95ae201e9224 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:30.253149 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41e9c04d-33a1-41ab-876d-95ae201e9224 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:30.356289 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-80445988-730f-4b45-bfbb-6b8115fd5962 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:30.356912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-80445988-730f-4b45-bfbb-6b8115fd5962 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:30.364224 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80445988-730f-4b45-bfbb-6b8115fd5962 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:30.364707 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80445988-730f-4b45-bfbb-6b8115fd5962 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:30.365149 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80445988-730f-4b45-bfbb-6b8115fd5962 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:30.365855 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80445988-730f-4b45-bfbb-6b8115fd5962 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:30.366308 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80445988-730f-4b45-bfbb-6b8115fd5962 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:30.366733 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80445988-730f-4b45-bfbb-6b8115fd5962 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:30.407008 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-41e9c04d-33a1-41ab-876d-95ae201e9224 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:30.415479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-41e9c04d-33a1-41ab-876d-95ae201e9224 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.176214 Oct 04 08:54:30.416073 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 200/361] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:30 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:30.503910 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-80445988-730f-4b45-bfbb-6b8115fd5962 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:30.515425 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-80445988-730f-4b45-bfbb-6b8115fd5962 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.162993 Oct 04 08:54:30.516060 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 162/362] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:30 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:31.246967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-90c53ecd-2c2d-4183-bde7-645f1a6a33a4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:31.247567 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-90c53ecd-2c2d-4183-bde7-645f1a6a33a4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:31.249671 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:31.255090 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90c53ecd-2c2d-4183-bde7-645f1a6a33a4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:31.255571 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90c53ecd-2c2d-4183-bde7-645f1a6a33a4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:31.256020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90c53ecd-2c2d-4183-bde7-645f1a6a33a4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:31.256697 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90c53ecd-2c2d-4183-bde7-645f1a6a33a4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:31.257135 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90c53ecd-2c2d-4183-bde7-645f1a6a33a4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:31.257544 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90c53ecd-2c2d-4183-bde7-645f1a6a33a4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:31.440033 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9e0555ef-f75f-4c04-96f2-266b9c2305ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:31.440802 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9e0555ef-f75f-4c04-96f2-266b9c2305ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:31.443029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:31.443658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=6 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:31.451712 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9e0555ef-f75f-4c04-96f2-266b9c2305ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:31.452242 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9e0555ef-f75f-4c04-96f2-266b9c2305ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:31.452658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9e0555ef-f75f-4c04-96f2-266b9c2305ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:31.453365 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9e0555ef-f75f-4c04-96f2-266b9c2305ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:31.453812 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9e0555ef-f75f-4c04-96f2-266b9c2305ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:31.454226 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9e0555ef-f75f-4c04-96f2-266b9c2305ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:31.618381 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-90c53ecd-2c2d-4183-bde7-645f1a6a33a4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:31.626347 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-90c53ecd-2c2d-4183-bde7-645f1a6a33a4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1318 microversion: 2.1 time: 0.383491 Oct 04 08:54:31.626888 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 201/363] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:31 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:31.631480 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e1c27640-9fe6-4448-9399-35456ff67408 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:31.632424 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e1c27640-9fe6-4448-9399-35456ff67408 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:31.638552 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e1c27640-9fe6-4448-9399-35456ff67408 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:31.639040 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e1c27640-9fe6-4448-9399-35456ff67408 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:31.639470 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e1c27640-9fe6-4448-9399-35456ff67408 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:31.640196 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e1c27640-9fe6-4448-9399-35456ff67408 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:31.640760 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e1c27640-9fe6-4448-9399-35456ff67408 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:31.641077 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e1c27640-9fe6-4448-9399-35456ff67408 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:31.660912 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=100 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:31.666701 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9e0555ef-f75f-4c04-96f2-266b9c2305ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:31.676490 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9e0555ef-f75f-4c04-96f2-266b9c2305ce tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.241590 Oct 04 08:54:31.677257 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 163/364] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:31 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:31.777114 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e1c27640-9fe6-4448-9399-35456ff67408 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:31.789871 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e1c27640-9fe6-4448-9399-35456ff67408 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.161550 Oct 04 08:54:31.790709 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 202/365] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:31 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:32.652029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ddacd01c-240e-4217-a7da-e969fe251f4a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:32.653580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ddacd01c-240e-4217-a7da-e969fe251f4a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:32.660455 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ddacd01c-240e-4217-a7da-e969fe251f4a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:32.661243 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ddacd01c-240e-4217-a7da-e969fe251f4a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:32.661666 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ddacd01c-240e-4217-a7da-e969fe251f4a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:32.662337 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ddacd01c-240e-4217-a7da-e969fe251f4a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:32.662781 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ddacd01c-240e-4217-a7da-e969fe251f4a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:32.663216 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ddacd01c-240e-4217-a7da-e969fe251f4a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:32.699998 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-73fdb702-86c6-4567-ab4d-3d59147910bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:32.700588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-73fdb702-86c6-4567-ab4d-3d59147910bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:32.707041 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-73fdb702-86c6-4567-ab4d-3d59147910bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:32.707609 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-73fdb702-86c6-4567-ab4d-3d59147910bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:32.708151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-73fdb702-86c6-4567-ab4d-3d59147910bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:32.708886 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-73fdb702-86c6-4567-ab4d-3d59147910bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:32.709327 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-73fdb702-86c6-4567-ab4d-3d59147910bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:32.709743 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-73fdb702-86c6-4567-ab4d-3d59147910bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:32.831555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ddacd01c-240e-4217-a7da-e969fe251f4a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:32.839732 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ddacd01c-240e-4217-a7da-e969fe251f4a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1318 microversion: 2.1 time: 0.192648 Oct 04 08:54:32.840589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 164/366] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:32 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:32.855821 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-454a9f0d-eabe-4b67-9297-2a72b05a57fb tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:32.856660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-454a9f0d-eabe-4b67-9297-2a72b05a57fb tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:32.862915 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-454a9f0d-eabe-4b67-9297-2a72b05a57fb tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:32.863429 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-454a9f0d-eabe-4b67-9297-2a72b05a57fb tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:32.863912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-454a9f0d-eabe-4b67-9297-2a72b05a57fb tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:32.864744 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-454a9f0d-eabe-4b67-9297-2a72b05a57fb tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:32.865180 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-454a9f0d-eabe-4b67-9297-2a72b05a57fb tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:32.865628 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-454a9f0d-eabe-4b67-9297-2a72b05a57fb tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:32.869364 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-73fdb702-86c6-4567-ab4d-3d59147910bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:32.878558 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-73fdb702-86c6-4567-ab4d-3d59147910bc tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.181961 Oct 04 08:54:32.881047 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 203/367] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:32 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:33.020694 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-454a9f0d-eabe-4b67-9297-2a72b05a57fb tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:33.031362 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-454a9f0d-eabe-4b67-9297-2a72b05a57fb tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.181674 Oct 04 08:54:33.031932 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 165/368] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:32 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:33.867790 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-23b1c0be-7c59-4dfa-9746-2d651f407ac6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:33.868848 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-23b1c0be-7c59-4dfa-9746-2d651f407ac6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:33.878893 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23b1c0be-7c59-4dfa-9746-2d651f407ac6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:33.879694 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23b1c0be-7c59-4dfa-9746-2d651f407ac6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:33.880494 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23b1c0be-7c59-4dfa-9746-2d651f407ac6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:33.881593 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23b1c0be-7c59-4dfa-9746-2d651f407ac6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:33.882328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23b1c0be-7c59-4dfa-9746-2d651f407ac6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:33.883018 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23b1c0be-7c59-4dfa-9746-2d651f407ac6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:33.901945 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-34279806-b8a5-491a-a527-67cb79986e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:33.902542 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-34279806-b8a5-491a-a527-67cb79986e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:33.909300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-34279806-b8a5-491a-a527-67cb79986e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:33.909785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-34279806-b8a5-491a-a527-67cb79986e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:33.910216 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-34279806-b8a5-491a-a527-67cb79986e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:33.910909 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-34279806-b8a5-491a-a527-67cb79986e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:33.911375 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-34279806-b8a5-491a-a527-67cb79986e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:33.911805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-34279806-b8a5-491a-a527-67cb79986e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:33.929999 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=100 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:34.072263 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-23b1c0be-7c59-4dfa-9746-2d651f407ac6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:34.081217 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-23b1c0be-7c59-4dfa-9746-2d651f407ac6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1318 microversion: 2.1 time: 0.220511 Oct 04 08:54:34.082333 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 204/369] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:33 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:34.086123 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-34279806-b8a5-491a-a527-67cb79986e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:34.087872 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0acbca50-6455-45ca-b494-e2fcf0ab2b0d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:34.088589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0acbca50-6455-45ca-b494-e2fcf0ab2b0d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:34.094525 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0acbca50-6455-45ca-b494-e2fcf0ab2b0d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:34.095097 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0acbca50-6455-45ca-b494-e2fcf0ab2b0d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:34.095531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0acbca50-6455-45ca-b494-e2fcf0ab2b0d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:34.096089 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-34279806-b8a5-491a-a527-67cb79986e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.197807 Oct 04 08:54:34.096317 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0acbca50-6455-45ca-b494-e2fcf0ab2b0d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:34.096773 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0acbca50-6455-45ca-b494-e2fcf0ab2b0d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:34.097194 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0acbca50-6455-45ca-b494-e2fcf0ab2b0d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:34.107381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 166/370] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:33 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:34.227140 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0acbca50-6455-45ca-b494-e2fcf0ab2b0d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:34.235431 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0acbca50-6455-45ca-b494-e2fcf0ab2b0d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1363 microversion: 2.1 time: 0.151195 Oct 04 08:54:34.236024 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 205/371] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:34 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:35.106681 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-930ba34a-e416-4799-ae14-c63447486c0d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:35.107291 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-930ba34a-e416-4799-ae14-c63447486c0d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:35.114894 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-930ba34a-e416-4799-ae14-c63447486c0d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.115381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-930ba34a-e416-4799-ae14-c63447486c0d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.115820 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-930ba34a-e416-4799-ae14-c63447486c0d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.116546 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-930ba34a-e416-4799-ae14-c63447486c0d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.116992 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-930ba34a-e416-4799-ae14-c63447486c0d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.117444 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-930ba34a-e416-4799-ae14-c63447486c0d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.133343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-fec08faf-15a2-45f6-aa01-416fc67843fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:35.133854 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-fec08faf-15a2-45f6-aa01-416fc67843fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:35.140158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fec08faf-15a2-45f6-aa01-416fc67843fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.140641 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fec08faf-15a2-45f6-aa01-416fc67843fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.141063 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fec08faf-15a2-45f6-aa01-416fc67843fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.141746 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fec08faf-15a2-45f6-aa01-416fc67843fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.142188 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fec08faf-15a2-45f6-aa01-416fc67843fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.142608 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fec08faf-15a2-45f6-aa01-416fc67843fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.317236 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-930ba34a-e416-4799-ae14-c63447486c0d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:35.325021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-fec08faf-15a2-45f6-aa01-416fc67843fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:35.327933 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-930ba34a-e416-4799-ae14-c63447486c0d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1318 microversion: 2.1 time: 0.225110 Oct 04 08:54:35.329062 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 167/372] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:35 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:35.333665 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b85480e0-6093-498a-b673-273bedd1d1e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:35.334290 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b85480e0-6093-498a-b673-273bedd1d1e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:35.340091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b85480e0-6093-498a-b673-273bedd1d1e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.340580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b85480e0-6093-498a-b673-273bedd1d1e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.341041 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b85480e0-6093-498a-b673-273bedd1d1e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.341763 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b85480e0-6093-498a-b673-273bedd1d1e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.342251 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b85480e0-6093-498a-b673-273bedd1d1e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.342639 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b85480e0-6093-498a-b673-273bedd1d1e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.356514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-fec08faf-15a2-45f6-aa01-416fc67843fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.220970 Oct 04 08:54:35.363610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 206/373] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:35 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:35.498052 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b85480e0-6093-498a-b673-273bedd1d1e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:35.505881 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b85480e0-6093-498a-b673-273bedd1d1e1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1549 microversion: 2.1 time: 0.175955 Oct 04 08:54:35.506676 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 168/374] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:35 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:35.529085 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4d1dac30-003d-4655-80f9-f151e9ec8a5e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:35.529944 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4d1dac30-003d-4655-80f9-f151e9ec8a5e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:35.536507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4d1dac30-003d-4655-80f9-f151e9ec8a5e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.537369 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4d1dac30-003d-4655-80f9-f151e9ec8a5e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.537369 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4d1dac30-003d-4655-80f9-f151e9ec8a5e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.538124 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4d1dac30-003d-4655-80f9-f151e9ec8a5e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.538629 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4d1dac30-003d-4655-80f9-f151e9ec8a5e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.539053 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4d1dac30-003d-4655-80f9-f151e9ec8a5e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.622780 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4d1dac30-003d-4655-80f9-f151e9ec8a5e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097818 Oct 04 08:54:35.623547 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 207/375] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Oct 4 08:54:35 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:35.670084 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-6b08f003-30c7-43d2-a4d7-75567a843df9 req-92196bb6-11ff-4a92-ba09-15c0b75981b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7814cb20-c3e8-4c17-a901-d62f4e7bc4af", "name": "network-vif-plugged", "status": "completed", "tag": "9af692a1-b931-4d82-9e18-3ab10e16c20a"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:35.680958 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-6b08f003-30c7-43d2-a4d7-75567a843df9 req-92196bb6-11ff-4a92-ba09-15c0b75981b3 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.682212 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-6b08f003-30c7-43d2-a4d7-75567a843df9 req-92196bb6-11ff-4a92-ba09-15c0b75981b3 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.682648 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-6b08f003-30c7-43d2-a4d7-75567a843df9 req-92196bb6-11ff-4a92-ba09-15c0b75981b3 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.695533 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-6b08f003-30c7-43d2-a4d7-75567a843df9 req-92196bb6-11ff-4a92-ba09-15c0b75981b3 service nova] Creating event network-vif-plugged:9af692a1-b931-4d82-9e18-3ab10e16c20a for instance 7814cb20-c3e8-4c17-a901-d62f4e7bc4af on hv-cinder-84456 Oct 04 08:54:35.701812 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-6b08f003-30c7-43d2-a4d7-75567a843df9 req-92196bb6-11ff-4a92-ba09-15c0b75981b3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036482 Oct 04 08:54:35.702761 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 169/376] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:36.353627 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6691a34b-33c3-4fec-b3e0-8ff38f7c59eb tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:36.354229 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6691a34b-33c3-4fec-b3e0-8ff38f7c59eb tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:36.360790 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6691a34b-33c3-4fec-b3e0-8ff38f7c59eb tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:36.361286 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6691a34b-33c3-4fec-b3e0-8ff38f7c59eb tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:36.361707 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6691a34b-33c3-4fec-b3e0-8ff38f7c59eb tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:36.362388 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6691a34b-33c3-4fec-b3e0-8ff38f7c59eb tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:36.363148 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6691a34b-33c3-4fec-b3e0-8ff38f7c59eb tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:36.363585 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6691a34b-33c3-4fec-b3e0-8ff38f7c59eb tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:36.381563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fbc16b29-737a-461f-8349-2ce37356abe3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:36.382248 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-fbc16b29-737a-461f-8349-2ce37356abe3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:36.397019 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fbc16b29-737a-461f-8349-2ce37356abe3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:36.397480 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fbc16b29-737a-461f-8349-2ce37356abe3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:36.397941 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fbc16b29-737a-461f-8349-2ce37356abe3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:36.398643 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fbc16b29-737a-461f-8349-2ce37356abe3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:36.399117 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fbc16b29-737a-461f-8349-2ce37356abe3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:36.399506 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fbc16b29-737a-461f-8349-2ce37356abe3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:36.548596 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6691a34b-33c3-4fec-b3e0-8ff38f7c59eb tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:36.556427 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6691a34b-33c3-4fec-b3e0-8ff38f7c59eb tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1318 microversion: 2.1 time: 0.206717 Oct 04 08:54:36.557119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 208/377] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:36 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:36.606147 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-fbc16b29-737a-461f-8349-2ce37356abe3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:36.614818 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fbc16b29-737a-461f-8349-2ce37356abe3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.238069 Oct 04 08:54:36.615490 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 170/378] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:36 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:37.018320 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-5f387339-f2c9-4e0e-b62b-b2691f52b71e req-699ff1c0-25d1-4040-90b5-a209ee3ab588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86725d76-c18e-4df2-94ff-93d73b5bc65f", "tag": "da852373-b7f7-4d27-921e-8fabd651eaa5"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:37.028071 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-5f387339-f2c9-4e0e-b62b-b2691f52b71e req-699ff1c0-25d1-4040-90b5-a209ee3ab588 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:37.028563 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-5f387339-f2c9-4e0e-b62b-b2691f52b71e req-699ff1c0-25d1-4040-90b5-a209ee3ab588 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:37.029004 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-5f387339-f2c9-4e0e-b62b-b2691f52b71e req-699ff1c0-25d1-4040-90b5-a209ee3ab588 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.040449 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-5f387339-f2c9-4e0e-b62b-b2691f52b71e req-699ff1c0-25d1-4040-90b5-a209ee3ab588 service nova] Creating event network-changed:da852373-b7f7-4d27-921e-8fabd651eaa5 for instance 86725d76-c18e-4df2-94ff-93d73b5bc65f on hv-cinder-84456 Oct 04 08:54:37.045609 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-5f387339-f2c9-4e0e-b62b-b2691f52b71e req-699ff1c0-25d1-4040-90b5-a209ee3ab588 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031043 Oct 04 08:54:37.046187 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 209/379] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:37.582030 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4c78304c-6964-43b9-9da8-af3a4b727a2d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:37.582924 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4c78304c-6964-43b9-9da8-af3a4b727a2d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:37.589790 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4c78304c-6964-43b9-9da8-af3a4b727a2d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:37.590389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4c78304c-6964-43b9-9da8-af3a4b727a2d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:37.590975 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4c78304c-6964-43b9-9da8-af3a4b727a2d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.591712 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4c78304c-6964-43b9-9da8-af3a4b727a2d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:37.592267 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4c78304c-6964-43b9-9da8-af3a4b727a2d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:37.592764 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4c78304c-6964-43b9-9da8-af3a4b727a2d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.637957 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-cf286823-7e5a-41c6-ae3e-de38ef74df8f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:37.638878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cf286823-7e5a-41c6-ae3e-de38ef74df8f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:37.645105 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cf286823-7e5a-41c6-ae3e-de38ef74df8f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:37.645579 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cf286823-7e5a-41c6-ae3e-de38ef74df8f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:37.645999 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cf286823-7e5a-41c6-ae3e-de38ef74df8f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.646883 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cf286823-7e5a-41c6-ae3e-de38ef74df8f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:37.647311 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cf286823-7e5a-41c6-ae3e-de38ef74df8f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:37.647725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cf286823-7e5a-41c6-ae3e-de38ef74df8f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.776088 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4c78304c-6964-43b9-9da8-af3a4b727a2d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:37.785781 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4c78304c-6964-43b9-9da8-af3a4b727a2d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1318 microversion: 2.1 time: 0.207656 Oct 04 08:54:37.786359 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 171/380] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:37 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:37.810250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cf286823-7e5a-41c6-ae3e-de38ef74df8f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:37.818251 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-cf286823-7e5a-41c6-ae3e-de38ef74df8f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.184525 Oct 04 08:54:37.818807 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 210/381] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:37 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:38.808579 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4fa41405-9731-4051-8a8f-5d47ebc4c6b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:38.809166 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4fa41405-9731-4051-8a8f-5d47ebc4c6b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:38.815825 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4fa41405-9731-4051-8a8f-5d47ebc4c6b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.816380 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4fa41405-9731-4051-8a8f-5d47ebc4c6b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.816812 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4fa41405-9731-4051-8a8f-5d47ebc4c6b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.817500 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4fa41405-9731-4051-8a8f-5d47ebc4c6b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.817948 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4fa41405-9731-4051-8a8f-5d47ebc4c6b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.818366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4fa41405-9731-4051-8a8f-5d47ebc4c6b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.841740 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4202dd30-76df-4126-97a2-c5439c329a9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:38.842412 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4202dd30-76df-4126-97a2-c5439c329a9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:38.849036 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4202dd30-76df-4126-97a2-c5439c329a9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.849500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4202dd30-76df-4126-97a2-c5439c329a9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.849993 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4202dd30-76df-4126-97a2-c5439c329a9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.850703 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4202dd30-76df-4126-97a2-c5439c329a9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.851148 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4202dd30-76df-4126-97a2-c5439c329a9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.851566 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4202dd30-76df-4126-97a2-c5439c329a9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:39.010488 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4fa41405-9731-4051-8a8f-5d47ebc4c6b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:39.018512 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4fa41405-9731-4051-8a8f-5d47ebc4c6b8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1318 microversion: 2.1 time: 0.213841 Oct 04 08:54:39.019074 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 172/382] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:38 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:39.025613 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4202dd30-76df-4126-97a2-c5439c329a9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:39.036074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4202dd30-76df-4126-97a2-c5439c329a9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.196158 Oct 04 08:54:39.036074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 211/383] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:38 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:40.041257 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9ecbbdc1-5b9d-4dd2-a8c8-fb237cddfbfd tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:40.043479 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9ecbbdc1-5b9d-4dd2-a8c8-fb237cddfbfd tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:40.049659 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ecbbdc1-5b9d-4dd2-a8c8-fb237cddfbfd tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:40.050192 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ecbbdc1-5b9d-4dd2-a8c8-fb237cddfbfd tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:40.050994 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ecbbdc1-5b9d-4dd2-a8c8-fb237cddfbfd tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:40.052197 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ecbbdc1-5b9d-4dd2-a8c8-fb237cddfbfd tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:40.052965 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ecbbdc1-5b9d-4dd2-a8c8-fb237cddfbfd tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:40.053602 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ecbbdc1-5b9d-4dd2-a8c8-fb237cddfbfd tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:40.058050 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-30e67e71-ef84-475c-8cc1-a2a0fa858959 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:40.065118 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-30e67e71-ef84-475c-8cc1-a2a0fa858959 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:40.083072 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-30e67e71-ef84-475c-8cc1-a2a0fa858959 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:40.083571 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-30e67e71-ef84-475c-8cc1-a2a0fa858959 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:40.084026 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-30e67e71-ef84-475c-8cc1-a2a0fa858959 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:40.084738 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-30e67e71-ef84-475c-8cc1-a2a0fa858959 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:40.085183 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-30e67e71-ef84-475c-8cc1-a2a0fa858959 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:40.085598 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-30e67e71-ef84-475c-8cc1-a2a0fa858959 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:40.350574 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9ecbbdc1-5b9d-4dd2-a8c8-fb237cddfbfd tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:40.358610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-30e67e71-ef84-475c-8cc1-a2a0fa858959 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:40.359502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9ecbbdc1-5b9d-4dd2-a8c8-fb237cddfbfd tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1318 microversion: 2.1 time: 0.322163 Oct 04 08:54:40.360228 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 173/384] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:40 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:40.367299 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-30e67e71-ef84-475c-8cc1-a2a0fa858959 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.314303 Oct 04 08:54:40.368179 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 212/385] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:40 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:41.386429 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-bca85b39-9b2e-4e9a-a6b2-4939e5ffdd8a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:41.387361 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-bca85b39-9b2e-4e9a-a6b2-4939e5ffdd8a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:41.395440 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2be89343-a5ab-40dd-a0e9-34ceec3f85bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:41.395920 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bca85b39-9b2e-4e9a-a6b2-4939e5ffdd8a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:41.396039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2be89343-a5ab-40dd-a0e9-34ceec3f85bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:41.396286 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bca85b39-9b2e-4e9a-a6b2-4939e5ffdd8a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:41.396727 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bca85b39-9b2e-4e9a-a6b2-4939e5ffdd8a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:41.397427 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bca85b39-9b2e-4e9a-a6b2-4939e5ffdd8a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:41.397880 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bca85b39-9b2e-4e9a-a6b2-4939e5ffdd8a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:41.398305 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bca85b39-9b2e-4e9a-a6b2-4939e5ffdd8a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:41.402018 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2be89343-a5ab-40dd-a0e9-34ceec3f85bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:41.402500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2be89343-a5ab-40dd-a0e9-34ceec3f85bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:41.402926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2be89343-a5ab-40dd-a0e9-34ceec3f85bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:41.403607 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2be89343-a5ab-40dd-a0e9-34ceec3f85bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:41.404086 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2be89343-a5ab-40dd-a0e9-34ceec3f85bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:41.404500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2be89343-a5ab-40dd-a0e9-34ceec3f85bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:41.595044 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-bca85b39-9b2e-4e9a-a6b2-4939e5ffdd8a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:41.598836 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2be89343-a5ab-40dd-a0e9-34ceec3f85bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:41.603219 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-bca85b39-9b2e-4e9a-a6b2-4939e5ffdd8a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1507 microversion: 2.1 time: 0.223072 Oct 04 08:54:41.603789 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 174/386] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:41 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:41.608055 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2be89343-a5ab-40dd-a0e9-34ceec3f85bd tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.216453 Oct 04 08:54:41.608729 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 213/387] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:41 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:42.632057 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-52720597-06ae-4908-8744-bee7be08d9f1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:42.632685 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-52720597-06ae-4908-8744-bee7be08d9f1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:42.639046 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-52720597-06ae-4908-8744-bee7be08d9f1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:42.639525 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-52720597-06ae-4908-8744-bee7be08d9f1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:42.639989 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-52720597-06ae-4908-8744-bee7be08d9f1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:42.640681 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-52720597-06ae-4908-8744-bee7be08d9f1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:42.641126 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-52720597-06ae-4908-8744-bee7be08d9f1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:42.641548 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-52720597-06ae-4908-8744-bee7be08d9f1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:42.784871 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-52720597-06ae-4908-8744-bee7be08d9f1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:42.794676 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-52720597-06ae-4908-8744-bee7be08d9f1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.166309 Oct 04 08:54:42.795656 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 175/388] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:42 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:43.822326 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-92d786ad-0832-46c0-bd25-232d52ec98a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:43.823262 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-92d786ad-0832-46c0-bd25-232d52ec98a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:43.833473 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-92d786ad-0832-46c0-bd25-232d52ec98a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:43.834267 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-92d786ad-0832-46c0-bd25-232d52ec98a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:43.834993 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-92d786ad-0832-46c0-bd25-232d52ec98a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:43.836200 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-92d786ad-0832-46c0-bd25-232d52ec98a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:43.836949 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-92d786ad-0832-46c0-bd25-232d52ec98a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:43.837649 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-92d786ad-0832-46c0-bd25-232d52ec98a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:43.980095 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-92d786ad-0832-46c0-bd25-232d52ec98a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:43.988799 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-92d786ad-0832-46c0-bd25-232d52ec98a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1502 microversion: 2.1 time: 0.172893 Oct 04 08:54:43.989467 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 214/389] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:43 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:44.011973 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1609c034-9750-4e9c-a726-2555dc1992b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1027555-2ba7-4cfa-931d-497800ecdc34"}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:44.014368 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1609c034-9750-4e9c-a726-2555dc1992b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:44.020894 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1609c034-9750-4e9c-a726-2555dc1992b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.021376 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1609c034-9750-4e9c-a726-2555dc1992b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.021816 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1609c034-9750-4e9c-a726-2555dc1992b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:44.022504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1609c034-9750-4e9c-a726-2555dc1992b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.022954 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1609c034-9750-4e9c-a726-2555dc1992b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.023376 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1609c034-9750-4e9c-a726-2555dc1992b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:44.050807 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-1609c034-9750-4e9c-a726-2555dc1992b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] HTTP exception thrown: Cannot 'attach_volume' instance d28f0369-796d-4b75-b047-ccf9a6998560 while it is in vm_state rescued Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1609c034-9750-4e9c-a726-2555dc1992b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Request method failure captured: Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: POST /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560/os-volume_attachments HTTP/1.1 Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 74 Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_QgccWxYajYjnYlxW2wOpmxEq7P2SD3jaoRxscKzYQChsbHwOl030EUF30Pu5JsIqD55efxkHlt99A0cxoM9Jnpj9RKPjJ0Gow11cqdorfXuhDlAAQMZmcLNdYXLD6ljS836T8ojAOd2thWO0Qa3jMLRufhlcsdQKqvbl-NKe8LtTQ Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: ba66b134261b494b964e9f050449a0fe Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1657257525 Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 08:54:44.052907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 08:54:44.054406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ba66b134261b494b964e9f050449a0fe", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ba66b134261b494b964e9f050449a0fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ba66b134261b494b964e9f050449a0fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ba66b134261b494b964e9f050449a0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:54:44.054406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1657257525 Oct 04 08:54:44.054406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: ba66b134261b494b964e9f050449a0fe Oct 04 08:54:44.054406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1657257525 Oct 04 08:54:44.054406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-ServerRescueNegativeTestJSON-1657257525-project Oct 04 08:54:44.054406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 08:54:44.054406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 08:54:44.054406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 1d22ff09fb6743c2880af0d7778fb984 Oct 04 08:54:44.054406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1657257525-project Oct 04 08:54:44.054406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Oct 04 08:54:44.054406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {"volumeAttachment": {"volumeId": "a1027555-2ba7-4cfa-931d-497800ecdc34"}} Oct 04 08:54:44.054406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Cannot 'attach_volume' instance d28f0369-796d-4b75-b047-ccf9a6998560 while it is in vm_state rescued Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'server_id': 'd28f0369-796d-4b75-b047-ccf9a6998560', 'body': {'volumeAttachment': {'volumeId': 'a1027555-2ba7-4cfa-931d-497800ecdc34'}}} Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d28f0369-796d-4b75-b047-ccf9a6998560 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:54:44.055404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d28f0369-796d-4b75-b047-ccf9a6998560 while it is in vm_state rescued Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:54:44.056788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:54:44.058137 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:54:44.058137 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:54:44.058137 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d28f0369-796d-4b75-b047-ccf9a6998560 while it is in vm_state rescued Oct 04 08:54:44.058137 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:54:44.058137 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1609c034-9750-4e9c-a726-2555dc1992b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Returning 409 to user: Cannot 'attach_volume' instance d28f0369-796d-4b75-b047-ccf9a6998560 while it is in vm_state rescued {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:54:44.058137 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1609c034-9750-4e9c-a726-2555dc1992b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "POST /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046840 Oct 04 08:54:44.058137 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 176/390] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Oct 4 08:54:44 2022] POST /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 08:54:44.064119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-90f83ece-af20-4042-a42a-72324e33d785 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:44.064749 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-90f83ece-af20-4042-a42a-72324e33d785 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:44.071431 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90f83ece-af20-4042-a42a-72324e33d785 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.071954 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90f83ece-af20-4042-a42a-72324e33d785 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.072391 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90f83ece-af20-4042-a42a-72324e33d785 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:44.073105 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90f83ece-af20-4042-a42a-72324e33d785 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.073556 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90f83ece-af20-4042-a42a-72324e33d785 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.073975 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90f83ece-af20-4042-a42a-72324e33d785 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:44.142551 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-90f83ece-af20-4042-a42a-72324e33d785 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "POST /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560/action" status: 202 len: 0 microversion: 2.1 time: 0.082579 Oct 04 08:54:44.143182 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 215/391] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Oct 4 08:54:44 2022] POST /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 08:54:44.151552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-60d998e6-bd30-4d7b-a7dd-798d956fd23f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:44.152280 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-60d998e6-bd30-4d7b-a7dd-798d956fd23f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:44.158949 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-60d998e6-bd30-4d7b-a7dd-798d956fd23f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.159442 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-60d998e6-bd30-4d7b-a7dd-798d956fd23f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.159876 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-60d998e6-bd30-4d7b-a7dd-798d956fd23f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:44.160606 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-60d998e6-bd30-4d7b-a7dd-798d956fd23f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.161059 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-60d998e6-bd30-4d7b-a7dd-798d956fd23f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.161484 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-60d998e6-bd30-4d7b-a7dd-798d956fd23f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:44.295466 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-60d998e6-bd30-4d7b-a7dd-798d956fd23f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:44.304312 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-60d998e6-bd30-4d7b-a7dd-798d956fd23f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1510 microversion: 2.1 time: 0.156714 Oct 04 08:54:44.304991 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 177/392] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:44 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:45.332373 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-db26ff49-86aa-48fc-9269-ec1d0d6fccac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:45.333527 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-db26ff49-86aa-48fc-9269-ec1d0d6fccac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:45.336640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=84 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:45.345907 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-db26ff49-86aa-48fc-9269-ec1d0d6fccac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.346734 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-db26ff49-86aa-48fc-9269-ec1d0d6fccac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.347480 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-db26ff49-86aa-48fc-9269-ec1d0d6fccac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.348192 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-db26ff49-86aa-48fc-9269-ec1d0d6fccac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.348646 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-db26ff49-86aa-48fc-9269-ec1d0d6fccac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.349070 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-db26ff49-86aa-48fc-9269-ec1d0d6fccac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.488010 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-db26ff49-86aa-48fc-9269-ec1d0d6fccac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:45.497170 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-db26ff49-86aa-48fc-9269-ec1d0d6fccac tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1510 microversion: 2.1 time: 0.172024 Oct 04 08:54:45.497776 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 216/393] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:45 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:46.530442 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f6cd8f95-4381-44fe-b95c-77f0128860a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:46.531364 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f6cd8f95-4381-44fe-b95c-77f0128860a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:46.542563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6cd8f95-4381-44fe-b95c-77f0128860a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:46.543350 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6cd8f95-4381-44fe-b95c-77f0128860a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:46.544119 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6cd8f95-4381-44fe-b95c-77f0128860a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:46.545293 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6cd8f95-4381-44fe-b95c-77f0128860a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:46.545992 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6cd8f95-4381-44fe-b95c-77f0128860a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:46.546686 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6cd8f95-4381-44fe-b95c-77f0128860a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:46.683326 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f6cd8f95-4381-44fe-b95c-77f0128860a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:46.691212 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f6cd8f95-4381-44fe-b95c-77f0128860a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1510 microversion: 2.1 time: 0.167317 Oct 04 08:54:46.691765 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 178/394] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:46 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:47.714591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-572a626e-a7a9-4373-ad7b-ec7daf762e40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:47.715201 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-572a626e-a7a9-4373-ad7b-ec7daf762e40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:47.721638 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-572a626e-a7a9-4373-ad7b-ec7daf762e40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:47.722121 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-572a626e-a7a9-4373-ad7b-ec7daf762e40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:47.722679 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-572a626e-a7a9-4373-ad7b-ec7daf762e40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:47.723362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-572a626e-a7a9-4373-ad7b-ec7daf762e40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:47.723810 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-572a626e-a7a9-4373-ad7b-ec7daf762e40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:47.724253 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-572a626e-a7a9-4373-ad7b-ec7daf762e40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:47.861998 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-572a626e-a7a9-4373-ad7b-ec7daf762e40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:47.870213 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-572a626e-a7a9-4373-ad7b-ec7daf762e40 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1510 microversion: 2.1 time: 0.159522 Oct 04 08:54:47.870762 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 217/395] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:47 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:48.896824 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-17654094-0f62-4892-880f-1e3b6d6c89eb tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:48.897434 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-17654094-0f62-4892-880f-1e3b6d6c89eb tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:48.903432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-17654094-0f62-4892-880f-1e3b6d6c89eb tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:48.903924 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-17654094-0f62-4892-880f-1e3b6d6c89eb tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:48.904380 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-17654094-0f62-4892-880f-1e3b6d6c89eb tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:48.905071 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-17654094-0f62-4892-880f-1e3b6d6c89eb tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:48.905521 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-17654094-0f62-4892-880f-1e3b6d6c89eb tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:48.905943 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-17654094-0f62-4892-880f-1e3b6d6c89eb tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.043522 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-17654094-0f62-4892-880f-1e3b6d6c89eb tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:49.051676 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-17654094-0f62-4892-880f-1e3b6d6c89eb tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1510 microversion: 2.1 time: 0.160581 Oct 04 08:54:49.052273 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 179/396] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:48 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:50.074889 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8e8f1d1b-1d51-4197-be5b-7e1d44c66d3f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:50.075542 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8e8f1d1b-1d51-4197-be5b-7e1d44c66d3f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:50.081761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e8f1d1b-1d51-4197-be5b-7e1d44c66d3f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:50.082575 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e8f1d1b-1d51-4197-be5b-7e1d44c66d3f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:50.083156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e8f1d1b-1d51-4197-be5b-7e1d44c66d3f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:50.083851 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e8f1d1b-1d51-4197-be5b-7e1d44c66d3f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:50.084406 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e8f1d1b-1d51-4197-be5b-7e1d44c66d3f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:50.084826 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e8f1d1b-1d51-4197-be5b-7e1d44c66d3f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:50.216098 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8e8f1d1b-1d51-4197-be5b-7e1d44c66d3f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:50.224215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8e8f1d1b-1d51-4197-be5b-7e1d44c66d3f tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1510 microversion: 2.1 time: 0.153058 Oct 04 08:54:50.224697 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 218/397] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:50 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:51.251378 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-aeaf95d6-686c-43b2-8c6d-f13afb43d060 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:51.252313 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-aeaf95d6-686c-43b2-8c6d-f13afb43d060 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:51.260453 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aeaf95d6-686c-43b2-8c6d-f13afb43d060 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:51.260938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aeaf95d6-686c-43b2-8c6d-f13afb43d060 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:51.261373 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aeaf95d6-686c-43b2-8c6d-f13afb43d060 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:51.262062 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aeaf95d6-686c-43b2-8c6d-f13afb43d060 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:51.262602 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aeaf95d6-686c-43b2-8c6d-f13afb43d060 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:51.262936 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aeaf95d6-686c-43b2-8c6d-f13afb43d060 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:51.390480 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-aeaf95d6-686c-43b2-8c6d-f13afb43d060 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:51.398915 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-aeaf95d6-686c-43b2-8c6d-f13afb43d060 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1510 microversion: 2.1 time: 0.154188 Oct 04 08:54:51.399502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 180/398] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:51 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:52.423087 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c32d2e0c-7b83-4668-86ff-b787c2d386f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:52.423618 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c32d2e0c-7b83-4668-86ff-b787c2d386f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:52.430230 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c32d2e0c-7b83-4668-86ff-b787c2d386f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:52.430703 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c32d2e0c-7b83-4668-86ff-b787c2d386f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:52.431126 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c32d2e0c-7b83-4668-86ff-b787c2d386f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:52.431811 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c32d2e0c-7b83-4668-86ff-b787c2d386f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:52.432328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c32d2e0c-7b83-4668-86ff-b787c2d386f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:52.432724 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c32d2e0c-7b83-4668-86ff-b787c2d386f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:52.436706 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:52.566505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c32d2e0c-7b83-4668-86ff-b787c2d386f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:52.577845 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c32d2e0c-7b83-4668-86ff-b787c2d386f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1510 microversion: 2.1 time: 0.158488 Oct 04 08:54:52.578612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 219/399] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:52 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:53.606535 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fe722867-cb40-4710-b48d-d92ab98d0650 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:53.607247 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-fe722867-cb40-4710-b48d-d92ab98d0650 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:53.615592 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fe722867-cb40-4710-b48d-d92ab98d0650 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.616195 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fe722867-cb40-4710-b48d-d92ab98d0650 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.616715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fe722867-cb40-4710-b48d-d92ab98d0650 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.617475 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fe722867-cb40-4710-b48d-d92ab98d0650 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.618053 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fe722867-cb40-4710-b48d-d92ab98d0650 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.619573 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fe722867-cb40-4710-b48d-d92ab98d0650 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.764510 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-fe722867-cb40-4710-b48d-d92ab98d0650 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:53.775073 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fe722867-cb40-4710-b48d-d92ab98d0650 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1510 microversion: 2.1 time: 0.175779 Oct 04 08:54:53.775699 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 181/400] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:53 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:54.797386 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-824fda2d-6dde-4d12-b857-90e38de7f28e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:54.798833 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-824fda2d-6dde-4d12-b857-90e38de7f28e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:54.810132 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-824fda2d-6dde-4d12-b857-90e38de7f28e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:54.810635 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-824fda2d-6dde-4d12-b857-90e38de7f28e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:54.811064 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-824fda2d-6dde-4d12-b857-90e38de7f28e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:54.811769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-824fda2d-6dde-4d12-b857-90e38de7f28e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:54.819979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-824fda2d-6dde-4d12-b857-90e38de7f28e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:54.820423 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-824fda2d-6dde-4d12-b857-90e38de7f28e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:55.011814 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-824fda2d-6dde-4d12-b857-90e38de7f28e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:55.020586 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-824fda2d-6dde-4d12-b857-90e38de7f28e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1516 microversion: 2.1 time: 0.227150 Oct 04 08:54:55.033036 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 220/401] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:54 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1516 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:56.488208 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d5c93354-5953-4f04-b32f-92a18c4b2b39 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Action: 'create', calling method: .version_select at 0x7ff92e5bb9d0>, body: {"keypair": {"name": "tempest-keypair-1796103133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjDrfdgxpx51QDWVn4ACV8CKd6H4NxyXGGVfIwr5ZF54yRRU1T2tpE05f97fQnya4fMV/HBiAGQ+Yh0ooDFEkCU2eu4QsQLHR2s7CkOqfUC1YL0SXlLmfM0g4xLKu6Hlg=="}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:56.505046 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-d5c93354-5953-4f04-b32f-92a18c4b2b39 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Getting quotas for project ba66b134261b494b964e9f050449a0fe. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:54:56.509518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-d5c93354-5953-4f04-b32f-92a18c4b2b39 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Getting quotas for user 1d22ff09fb6743c2880af0d7778fb984 and project ba66b134261b494b964e9f050449a0fe. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:54:56.535321 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d5c93354-5953-4f04-b32f-92a18c4b2b39 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052286 Oct 04 08:54:56.538082 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 182/402] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Oct 4 08:54:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:54:58.011384 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1897917062", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d6644cc-03e9-4e6d-b6f1-c27cc0c7c185"}], "security_groups": [{"name": "tempest-securitygroup--1431224949"}], "key_name": "tempest-keypair-1796103133", "user_data": "}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:58.160141 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.network.neutron [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] validate_networks() for [('9d6644cc-03e9-4e6d-b6f1-c27cc0c7c185', None, None, None, None, None)] {{(pid=142438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:54:58.980964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Flavor limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:54:58.981628 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Image limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:54:58.982588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Flavor pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:54:58.983504 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Image pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:54:58.983937 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:54:58.994136 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:58.994614 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:58.995044 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:58.995760 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:58.996255 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:58.996682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:59.018627 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Getting quotas for project ba66b134261b494b964e9f050449a0fe. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:54:59.023755 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Getting quotas for user 1d22ff09fb6743c2880af0d7778fb984 and project ba66b134261b494b964e9f050449a0fe. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:54:59.046070 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Going to run 1 instances... {{(pid=142438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:54:59.055426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:54:59.110453 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR oslo.messaging._drivers.impl_rabbit [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [bd1ce334-b8b6-487f-9bc1-a36cdae4afd4] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 08:55:00.124465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO oslo.messaging._drivers.impl_rabbit [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [bd1ce334-b8b6-487f-9bc1-a36cdae4afd4] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 44470. Oct 04 08:55:00.129740 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-caf9f32a-2d1f-4dd1-b329-fe360cceaf69 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.123329 Oct 04 08:55:00.131480 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 221/403] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 08:54:58 2022] POST /compute/v2.1/servers => generated 409 bytes in 2126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:55:00.142440 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-219409c8-f885-4761-b058-6761f33e3f15 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:00.144281 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-219409c8-f885-4761-b058-6761f33e3f15 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:00.150974 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:00.217543 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-219409c8-f885-4761-b058-6761f33e3f15 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:00.227880 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-219409c8-f885-4761-b058-6761f33e3f15 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1246 microversion: 2.1 time: 0.089330 Oct 04 08:55:00.228775 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 183/404] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:00 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:01.266066 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4eb4a1ee-6ec2-461b-aa26-8ef87c32fbbf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:01.266708 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4eb4a1ee-6ec2-461b-aa26-8ef87c32fbbf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:01.277002 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4eb4a1ee-6ec2-461b-aa26-8ef87c32fbbf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:01.277667 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4eb4a1ee-6ec2-461b-aa26-8ef87c32fbbf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:01.277891 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4eb4a1ee-6ec2-461b-aa26-8ef87c32fbbf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:01.279037 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4eb4a1ee-6ec2-461b-aa26-8ef87c32fbbf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:01.288305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4eb4a1ee-6ec2-461b-aa26-8ef87c32fbbf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:01.291538 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4eb4a1ee-6ec2-461b-aa26-8ef87c32fbbf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:01.391208 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4eb4a1ee-6ec2-461b-aa26-8ef87c32fbbf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:01.402706 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4eb4a1ee-6ec2-461b-aa26-8ef87c32fbbf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1298 microversion: 2.1 time: 0.150290 Oct 04 08:55:01.403516 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 222/405] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:01 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1298 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:02.442298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d3a0258a-df9d-4c66-b5cc-1ab206420266 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:02.443568 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d3a0258a-df9d-4c66-b5cc-1ab206420266 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:02.453412 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d3a0258a-df9d-4c66-b5cc-1ab206420266 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:02.454220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d3a0258a-df9d-4c66-b5cc-1ab206420266 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:02.454827 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d3a0258a-df9d-4c66-b5cc-1ab206420266 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:02.455707 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d3a0258a-df9d-4c66-b5cc-1ab206420266 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:02.456452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d3a0258a-df9d-4c66-b5cc-1ab206420266 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:02.457037 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d3a0258a-df9d-4c66-b5cc-1ab206420266 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:02.602351 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d3a0258a-df9d-4c66-b5cc-1ab206420266 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:02.613627 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d3a0258a-df9d-4c66-b5cc-1ab206420266 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1304 microversion: 2.1 time: 0.177216 Oct 04 08:55:02.616206 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 184/406] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:02 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:03.643545 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5bc70452-8da9-4d18-908c-10a08efbce9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:03.644349 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5bc70452-8da9-4d18-908c-10a08efbce9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:03.655091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5bc70452-8da9-4d18-908c-10a08efbce9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:03.656704 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5bc70452-8da9-4d18-908c-10a08efbce9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:03.658816 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5bc70452-8da9-4d18-908c-10a08efbce9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:03.659793 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5bc70452-8da9-4d18-908c-10a08efbce9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:03.663369 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5bc70452-8da9-4d18-908c-10a08efbce9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:03.664113 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5bc70452-8da9-4d18-908c-10a08efbce9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:04.045502 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5bc70452-8da9-4d18-908c-10a08efbce9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:04.054661 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5bc70452-8da9-4d18-908c-10a08efbce9e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1372 microversion: 2.1 time: 0.415340 Oct 04 08:55:04.071272 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 223/407] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:03 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1372 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:04.230965 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-00f7897e-9e3d-4c7d-9d25-271c31c04f03 req-183dc6b3-2a80-4d15-ac0f-04bef9b7b1ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d4e170-63f9-4fa3-858f-9be84ff18613", "tag": "f3fc8c79-adbb-46ec-b7f3-b0d7539f5735"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:04.246575 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-00f7897e-9e3d-4c7d-9d25-271c31c04f03 req-183dc6b3-2a80-4d15-ac0f-04bef9b7b1ab service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:04.247297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-00f7897e-9e3d-4c7d-9d25-271c31c04f03 req-183dc6b3-2a80-4d15-ac0f-04bef9b7b1ab service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:04.247665 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-00f7897e-9e3d-4c7d-9d25-271c31c04f03 req-183dc6b3-2a80-4d15-ac0f-04bef9b7b1ab service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:04.264454 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=93 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:04.270610 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-00f7897e-9e3d-4c7d-9d25-271c31c04f03 req-183dc6b3-2a80-4d15-ac0f-04bef9b7b1ab service nova] Creating event network-changed:f3fc8c79-adbb-46ec-b7f3-b0d7539f5735 for instance e8d4e170-63f9-4fa3-858f-9be84ff18613 on hv-cinder-84456 Oct 04 08:55:04.278624 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-00f7897e-9e3d-4c7d-9d25-271c31c04f03 req-183dc6b3-2a80-4d15-ac0f-04bef9b7b1ab service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052239 Oct 04 08:55:04.281054 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 185/408] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:05.030282 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-299712552", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "networks": [{"uuid": "5be304a6-e77b-4f6e-a85c-032512625b32"}]}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:05.078234 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-10c0da1e-e275-43b9-af4e-cf68ae368def tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:05.078930 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-10c0da1e-e275-43b9-af4e-cf68ae368def tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:05.085975 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10c0da1e-e275-43b9-af4e-cf68ae368def tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:05.086653 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10c0da1e-e275-43b9-af4e-cf68ae368def tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:05.087286 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10c0da1e-e275-43b9-af4e-cf68ae368def tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:05.088203 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10c0da1e-e275-43b9-af4e-cf68ae368def tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:05.088866 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10c0da1e-e275-43b9-af4e-cf68ae368def tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:05.089497 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10c0da1e-e275-43b9-af4e-cf68ae368def tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:05.090049 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.network.neutron [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] validate_networks() for [('5be304a6-e77b-4f6e-a85c-032512625b32', None, None, None, None, None)] {{(pid=142438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:55:05.300992 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-10c0da1e-e275-43b9-af4e-cf68ae368def tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:05.310505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-10c0da1e-e275-43b9-af4e-cf68ae368def tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1372 microversion: 2.1 time: 0.236775 Oct 04 08:55:05.311746 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 186/409] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:05 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1372 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:05.848817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Flavor limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:55:05.850320 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Image limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:55:05.851563 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Flavor pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:55:05.852651 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Image pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:55:05.853333 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:55:05.864430 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:05.865325 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:05.866480 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:05.867585 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:05.868356 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:05.869019 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:05.889115 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Getting quotas for project d66d40b700e242eebfd51f2469879a3a. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:55:05.893704 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Getting quotas for user 3b636220f1dd443eacdeb3f975736dfc and project d66d40b700e242eebfd51f2469879a3a. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:55:05.906394 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Going to run 1 instances... {{(pid=142438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:55:05.908869 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:55:05.962264 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-64ee39c7-4076-4088-a9d8-26891c53a40c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.936699 Oct 04 08:55:05.968056 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 224/410] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 08:55:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:55:05.975199 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8bf1bc13-1b54-403c-81d7-5895294f96d9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:05.975824 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8bf1bc13-1b54-403c-81d7-5895294f96d9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:06.039630 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8bf1bc13-1b54-403c-81d7-5895294f96d9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:06.060060 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8bf1bc13-1b54-403c-81d7-5895294f96d9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1213 microversion: 2.1 time: 0.089075 Oct 04 08:55:06.071996 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 187/411] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:05 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:06.336038 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c3efd032-b142-4f89-9086-0b8e18327939 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:06.336657 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c3efd032-b142-4f89-9086-0b8e18327939 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:06.348653 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c3efd032-b142-4f89-9086-0b8e18327939 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:06.349258 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c3efd032-b142-4f89-9086-0b8e18327939 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:06.349931 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c3efd032-b142-4f89-9086-0b8e18327939 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:06.350759 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c3efd032-b142-4f89-9086-0b8e18327939 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:06.351724 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c3efd032-b142-4f89-9086-0b8e18327939 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:06.352398 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c3efd032-b142-4f89-9086-0b8e18327939 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:06.580585 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c3efd032-b142-4f89-9086-0b8e18327939 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:06.595228 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c3efd032-b142-4f89-9086-0b8e18327939 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1372 microversion: 2.1 time: 0.262575 Oct 04 08:55:06.597032 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 225/412] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:06 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1372 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:07.086314 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ae1dcc18-0634-499f-a2d7-53195e57c707 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:07.086924 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ae1dcc18-0634-499f-a2d7-53195e57c707 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:07.094846 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ae1dcc18-0634-499f-a2d7-53195e57c707 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.095428 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ae1dcc18-0634-499f-a2d7-53195e57c707 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.095858 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ae1dcc18-0634-499f-a2d7-53195e57c707 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.096577 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ae1dcc18-0634-499f-a2d7-53195e57c707 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.097033 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ae1dcc18-0634-499f-a2d7-53195e57c707 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.097452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ae1dcc18-0634-499f-a2d7-53195e57c707 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.165672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ae1dcc18-0634-499f-a2d7-53195e57c707 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:07.174340 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ae1dcc18-0634-499f-a2d7-53195e57c707 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1217 microversion: 2.1 time: 0.091225 Oct 04 08:55:07.174340 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 188/413] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:07 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:07.621878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8f7cd4d8-832a-4018-8636-cdf2dc693d58 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:07.622490 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8f7cd4d8-832a-4018-8636-cdf2dc693d58 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:07.631902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8f7cd4d8-832a-4018-8636-cdf2dc693d58 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.632355 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8f7cd4d8-832a-4018-8636-cdf2dc693d58 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.632785 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8f7cd4d8-832a-4018-8636-cdf2dc693d58 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.633487 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8f7cd4d8-832a-4018-8636-cdf2dc693d58 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.633932 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8f7cd4d8-832a-4018-8636-cdf2dc693d58 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.634343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8f7cd4d8-832a-4018-8636-cdf2dc693d58 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.803479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8f7cd4d8-832a-4018-8636-cdf2dc693d58 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:07.813421 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8f7cd4d8-832a-4018-8636-cdf2dc693d58 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1372 microversion: 2.1 time: 0.195959 Oct 04 08:55:07.815552 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 226/414] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:07 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1372 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:08.198029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-815382bb-b08c-48cf-b335-f993306856e4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:08.198635 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-815382bb-b08c-48cf-b335-f993306856e4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:08.207444 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-815382bb-b08c-48cf-b335-f993306856e4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:08.208312 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-815382bb-b08c-48cf-b335-f993306856e4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:08.209001 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-815382bb-b08c-48cf-b335-f993306856e4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:08.212610 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-815382bb-b08c-48cf-b335-f993306856e4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:08.214809 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-815382bb-b08c-48cf-b335-f993306856e4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:08.215448 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-815382bb-b08c-48cf-b335-f993306856e4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:08.306577 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-815382bb-b08c-48cf-b335-f993306856e4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:08.319652 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-815382bb-b08c-48cf-b335-f993306856e4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1217 microversion: 2.1 time: 0.124796 Oct 04 08:55:08.340727 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 189/415] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:08 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:08.837933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6cab9c4b-5ec0-42b8-9ec5-848973808ce3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:08.838542 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6cab9c4b-5ec0-42b8-9ec5-848973808ce3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:08.851516 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6cab9c4b-5ec0-42b8-9ec5-848973808ce3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:08.852034 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6cab9c4b-5ec0-42b8-9ec5-848973808ce3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:08.852490 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6cab9c4b-5ec0-42b8-9ec5-848973808ce3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:08.853145 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6cab9c4b-5ec0-42b8-9ec5-848973808ce3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:08.853591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6cab9c4b-5ec0-42b8-9ec5-848973808ce3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:08.854003 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6cab9c4b-5ec0-42b8-9ec5-848973808ce3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:09.146156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6cab9c4b-5ec0-42b8-9ec5-848973808ce3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:09.162850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6cab9c4b-5ec0-42b8-9ec5-848973808ce3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1372 microversion: 2.1 time: 0.328495 Oct 04 08:55:09.164329 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 227/416] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:08 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1372 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:09.343043 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-721c8568-34fe-41d4-8e1c-b1a1bdde45d7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:09.343706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-721c8568-34fe-41d4-8e1c-b1a1bdde45d7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:09.351248 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-721c8568-34fe-41d4-8e1c-b1a1bdde45d7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:09.352085 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-721c8568-34fe-41d4-8e1c-b1a1bdde45d7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:09.352518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-721c8568-34fe-41d4-8e1c-b1a1bdde45d7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:09.353559 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-721c8568-34fe-41d4-8e1c-b1a1bdde45d7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:09.354185 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-721c8568-34fe-41d4-8e1c-b1a1bdde45d7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:09.354754 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-721c8568-34fe-41d4-8e1c-b1a1bdde45d7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:09.439712 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-721c8568-34fe-41d4-8e1c-b1a1bdde45d7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:09.462641 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-721c8568-34fe-41d4-8e1c-b1a1bdde45d7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1217 microversion: 2.1 time: 0.123353 Oct 04 08:55:09.465762 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 190/417] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:09 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:10.193079 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-bd919dd1-7356-4c7d-8310-d17fa07685d3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:10.194534 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-bd919dd1-7356-4c7d-8310-d17fa07685d3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:10.201901 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bd919dd1-7356-4c7d-8310-d17fa07685d3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:10.203379 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bd919dd1-7356-4c7d-8310-d17fa07685d3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:10.204117 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bd919dd1-7356-4c7d-8310-d17fa07685d3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:10.205127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bd919dd1-7356-4c7d-8310-d17fa07685d3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:10.206327 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bd919dd1-7356-4c7d-8310-d17fa07685d3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:10.206980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bd919dd1-7356-4c7d-8310-d17fa07685d3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:10.494656 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a0184c26-4ce2-4606-a0e5-a09749c05625 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:10.495505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a0184c26-4ce2-4606-a0e5-a09749c05625 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:10.509178 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0184c26-4ce2-4606-a0e5-a09749c05625 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:10.509683 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0184c26-4ce2-4606-a0e5-a09749c05625 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:10.511107 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-bd919dd1-7356-4c7d-8310-d17fa07685d3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:10.511468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0184c26-4ce2-4606-a0e5-a09749c05625 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:10.514325 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0184c26-4ce2-4606-a0e5-a09749c05625 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:10.514800 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0184c26-4ce2-4606-a0e5-a09749c05625 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:10.515567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0184c26-4ce2-4606-a0e5-a09749c05625 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:10.519525 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-bd919dd1-7356-4c7d-8310-d17fa07685d3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1372 microversion: 2.1 time: 0.336320 Oct 04 08:55:10.540261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 228/418] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:10 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1372 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:10.677478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a0184c26-4ce2-4606-a0e5-a09749c05625 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:10.690772 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a0184c26-4ce2-4606-a0e5-a09749c05625 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1265 microversion: 2.1 time: 0.201665 Oct 04 08:55:10.692050 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 191/419] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:10 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:11.245871 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6b34a459-9fae-4287-a7b6-6332736f71a8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Action: 'create', calling method: .version_select at 0x7ff92e4ac820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2035428488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYQmeDMQdkKOlGfPKEUNrcliEAWRCI7XshHLYgSL/rR01Dup1O+nraI8dfHPh2qY1HZkIW1YBVMv+GqwWRbKT1M2lE5X69dsiRR1LYIpzHzz4ygW2kPud+5SDUbB4LqKg=="}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:11.289683 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-6b34a459-9fae-4287-a7b6-6332736f71a8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Getting quotas for project 881a40342cb84608b961e6b32dceadb4. Resources: {'key_pairs'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:55:11.294801 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-6b34a459-9fae-4287-a7b6-6332736f71a8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Getting quotas for user d8d329978baf425e954b9965ae0cb652 and project 881a40342cb84608b961e6b32dceadb4. Resources: {'key_pairs'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:55:11.352983 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6b34a459-9fae-4287-a7b6-6332736f71a8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.427803 Oct 04 08:55:11.354350 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 229/420] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Oct 4 08:55:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:11.544312 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-96c144eb-4f6c-4616-95ee-a71364b4faf3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:11.545752 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-96c144eb-4f6c-4616-95ee-a71364b4faf3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:11.572852 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-96c144eb-4f6c-4616-95ee-a71364b4faf3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:11.573358 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-96c144eb-4f6c-4616-95ee-a71364b4faf3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:11.573990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-96c144eb-4f6c-4616-95ee-a71364b4faf3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:11.575033 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-96c144eb-4f6c-4616-95ee-a71364b4faf3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:11.576009 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-96c144eb-4f6c-4616-95ee-a71364b4faf3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:11.582401 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-96c144eb-4f6c-4616-95ee-a71364b4faf3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:11.726260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-98194b23-89ba-4d9e-80c7-e7a6562b1cfa tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:11.727430 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-98194b23-89ba-4d9e-80c7-e7a6562b1cfa tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:11.741904 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-98194b23-89ba-4d9e-80c7-e7a6562b1cfa tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:11.742496 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-98194b23-89ba-4d9e-80c7-e7a6562b1cfa tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:11.743025 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-98194b23-89ba-4d9e-80c7-e7a6562b1cfa tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:11.743816 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-98194b23-89ba-4d9e-80c7-e7a6562b1cfa tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:11.744400 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-98194b23-89ba-4d9e-80c7-e7a6562b1cfa tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:11.745050 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-98194b23-89ba-4d9e-80c7-e7a6562b1cfa tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:11.849021 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-96c144eb-4f6c-4616-95ee-a71364b4faf3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:11.865136 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-96c144eb-4f6c-4616-95ee-a71364b4faf3 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1372 microversion: 2.1 time: 0.318131 Oct 04 08:55:11.865907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 192/421] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:11 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1372 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:11.919252 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-98194b23-89ba-4d9e-80c7-e7a6562b1cfa tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:11.926934 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-98194b23-89ba-4d9e-80c7-e7a6562b1cfa tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1313 microversion: 2.1 time: 0.204742 Oct 04 08:55:11.927501 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 230/422] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:11 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:12.563533 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-167de9a5-c5b5-4b7c-b1aa-65c221963dbd req-9076d979-d29b-41c9-9a86-16c3f613bac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d747a410-d796-4b53-85d5-6bc7ef085851", "tag": "75354e64-e7e8-401b-9575-247c3db9f79e"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:12.574980 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-167de9a5-c5b5-4b7c-b1aa-65c221963dbd req-9076d979-d29b-41c9-9a86-16c3f613bac8 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:12.575456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-167de9a5-c5b5-4b7c-b1aa-65c221963dbd req-9076d979-d29b-41c9-9a86-16c3f613bac8 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:12.576697 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-167de9a5-c5b5-4b7c-b1aa-65c221963dbd req-9076d979-d29b-41c9-9a86-16c3f613bac8 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:12.599958 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-167de9a5-c5b5-4b7c-b1aa-65c221963dbd req-9076d979-d29b-41c9-9a86-16c3f613bac8 service nova] Creating event network-changed:75354e64-e7e8-401b-9575-247c3db9f79e for instance d747a410-d796-4b53-85d5-6bc7ef085851 on hv-cinder-84456 Oct 04 08:55:12.605512 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-167de9a5-c5b5-4b7c-b1aa-65c221963dbd req-9076d979-d29b-41c9-9a86-16c3f613bac8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045832 Oct 04 08:55:12.606540 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 193/423] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:12.887932 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7adf1ac7-ea21-4b4d-81bc-fc5596d41612 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:12.889384 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7adf1ac7-ea21-4b4d-81bc-fc5596d41612 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:12.898162 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7adf1ac7-ea21-4b4d-81bc-fc5596d41612 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:12.910538 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7adf1ac7-ea21-4b4d-81bc-fc5596d41612 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:12.911976 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7adf1ac7-ea21-4b4d-81bc-fc5596d41612 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:12.912903 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7adf1ac7-ea21-4b4d-81bc-fc5596d41612 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:12.914089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7adf1ac7-ea21-4b4d-81bc-fc5596d41612 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:12.914631 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7adf1ac7-ea21-4b4d-81bc-fc5596d41612 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:12.952573 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a1218ee7-0e99-4094-b431-df3ff5d91da2 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:12.953265 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a1218ee7-0e99-4094-b431-df3ff5d91da2 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:12.961544 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a1218ee7-0e99-4094-b431-df3ff5d91da2 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:12.962082 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a1218ee7-0e99-4094-b431-df3ff5d91da2 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:12.962694 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a1218ee7-0e99-4094-b431-df3ff5d91da2 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:12.963784 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a1218ee7-0e99-4094-b431-df3ff5d91da2 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:12.964525 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a1218ee7-0e99-4094-b431-df3ff5d91da2 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:12.976032 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a1218ee7-0e99-4094-b431-df3ff5d91da2 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:13.189176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7adf1ac7-ea21-4b4d-81bc-fc5596d41612 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:13.203590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7adf1ac7-ea21-4b4d-81bc-fc5596d41612 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1372 microversion: 2.1 time: 0.319497 Oct 04 08:55:13.205891 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 231/424] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:12 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1372 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:13.211262 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-9bbd9508-bf73-4d68-84de-83ff16a112df req-928d2e10-b14b-43a9-a82a-965a03186db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d4e170-63f9-4fa3-858f-9be84ff18613", "name": "network-vif-plugged", "status": "completed", "tag": "f3fc8c79-adbb-46ec-b7f3-b0d7539f5735"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:13.214560 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a1218ee7-0e99-4094-b431-df3ff5d91da2 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:13.222583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a1218ee7-0e99-4094-b431-df3ff5d91da2 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1313 microversion: 2.1 time: 0.275947 Oct 04 08:55:13.223130 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-9bbd9508-bf73-4d68-84de-83ff16a112df req-928d2e10-b14b-43a9-a82a-965a03186db4 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:13.223581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-9bbd9508-bf73-4d68-84de-83ff16a112df req-928d2e10-b14b-43a9-a82a-965a03186db4 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:13.224113 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-9bbd9508-bf73-4d68-84de-83ff16a112df req-928d2e10-b14b-43a9-a82a-965a03186db4 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:13.224435 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 194/425] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:12 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:13.240925 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-9bbd9508-bf73-4d68-84de-83ff16a112df req-928d2e10-b14b-43a9-a82a-965a03186db4 service nova] Creating event network-vif-plugged:f3fc8c79-adbb-46ec-b7f3-b0d7539f5735 for instance e8d4e170-63f9-4fa3-858f-9be84ff18613 on hv-cinder-84456 Oct 04 08:55:13.247393 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-9bbd9508-bf73-4d68-84de-83ff16a112df req-928d2e10-b14b-43a9-a82a-965a03186db4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039912 Oct 04 08:55:13.253078 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 232/426] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:13.305676 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8b4aab73-3cec-4ea5-8cae-94c8cb7f8846 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "113183f4-ec1a-4abb-acbb-b59b9a1ed93c", "device": "/dev/sdb"}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:13.308694 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8b4aab73-3cec-4ea5-8cae-94c8cb7f8846 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:13.315001 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8b4aab73-3cec-4ea5-8cae-94c8cb7f8846 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:13.315498 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8b4aab73-3cec-4ea5-8cae-94c8cb7f8846 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:13.316003 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8b4aab73-3cec-4ea5-8cae-94c8cb7f8846 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:13.316705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8b4aab73-3cec-4ea5-8cae-94c8cb7f8846 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:13.317155 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8b4aab73-3cec-4ea5-8cae-94c8cb7f8846 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:13.317576 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8b4aab73-3cec-4ea5-8cae-94c8cb7f8846 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:14.231781 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-41cc7b90-4a59-449e-b7a7-f93430ef8e31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:14.232503 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-41cc7b90-4a59-449e-b7a7-f93430ef8e31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:14.242956 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41cc7b90-4a59-449e-b7a7-f93430ef8e31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:14.243441 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41cc7b90-4a59-449e-b7a7-f93430ef8e31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:14.245402 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41cc7b90-4a59-449e-b7a7-f93430ef8e31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:14.246373 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41cc7b90-4a59-449e-b7a7-f93430ef8e31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:14.246828 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41cc7b90-4a59-449e-b7a7-f93430ef8e31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:14.247243 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41cc7b90-4a59-449e-b7a7-f93430ef8e31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:14.382190 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-41cc7b90-4a59-449e-b7a7-f93430ef8e31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:14.389888 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-41cc7b90-4a59-449e-b7a7-f93430ef8e31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1372 microversion: 2.1 time: 0.162771 Oct 04 08:55:14.390644 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 233/427] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:14 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:14.395250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-04b05647-fcf9-4927-9f0c-322f0c8aabbc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:14.395853 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-04b05647-fcf9-4927-9f0c-322f0c8aabbc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:14.401910 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-04b05647-fcf9-4927-9f0c-322f0c8aabbc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:14.402387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-04b05647-fcf9-4927-9f0c-322f0c8aabbc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:14.402982 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-04b05647-fcf9-4927-9f0c-322f0c8aabbc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:14.403835 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-04b05647-fcf9-4927-9f0c-322f0c8aabbc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:14.404449 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-04b05647-fcf9-4927-9f0c-322f0c8aabbc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:14.405113 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-04b05647-fcf9-4927-9f0c-322f0c8aabbc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:14.537540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-04b05647-fcf9-4927-9f0c-322f0c8aabbc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:14.545490 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-04b05647-fcf9-4927-9f0c-322f0c8aabbc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1313 microversion: 2.1 time: 0.153721 Oct 04 08:55:14.546058 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 234/428] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:14 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:15.415780 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5c3edabc-3cfa-4a79-9345-b475a618574b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:15.416470 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5c3edabc-3cfa-4a79-9345-b475a618574b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:15.418585 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=7 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:15.424228 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c3edabc-3cfa-4a79-9345-b475a618574b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:15.424990 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c3edabc-3cfa-4a79-9345-b475a618574b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:15.425417 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c3edabc-3cfa-4a79-9345-b475a618574b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:15.426103 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c3edabc-3cfa-4a79-9345-b475a618574b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:15.426557 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c3edabc-3cfa-4a79-9345-b475a618574b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:15.426970 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c3edabc-3cfa-4a79-9345-b475a618574b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:15.599408 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5c3edabc-3cfa-4a79-9345-b475a618574b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:15.608335 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5c3edabc-3cfa-4a79-9345-b475a618574b tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1372 microversion: 2.1 time: 0.197318 Oct 04 08:55:15.608933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 235/429] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:15 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1372 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:15.614155 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c0e4365d-bf42-4a52-8c14-85f3bf935f5a tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:15.614969 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c0e4365d-bf42-4a52-8c14-85f3bf935f5a tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:15.621254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0e4365d-bf42-4a52-8c14-85f3bf935f5a tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:15.621735 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0e4365d-bf42-4a52-8c14-85f3bf935f5a tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:15.622164 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0e4365d-bf42-4a52-8c14-85f3bf935f5a tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:15.622857 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0e4365d-bf42-4a52-8c14-85f3bf935f5a tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:15.623299 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0e4365d-bf42-4a52-8c14-85f3bf935f5a tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:15.623715 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0e4365d-bf42-4a52-8c14-85f3bf935f5a tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:15.762015 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c0e4365d-bf42-4a52-8c14-85f3bf935f5a tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:15.772111 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c0e4365d-bf42-4a52-8c14-85f3bf935f5a tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1313 microversion: 2.1 time: 0.161802 Oct 04 08:55:15.773190 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 236/430] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:15 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:16.046278 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=8 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:16.285253 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8b4aab73-3cec-4ea5-8cae-94c8cb7f8846 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "POST /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.983362 Oct 04 08:55:16.286281 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 195/431] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Oct 4 08:55:13 2022] POST /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af/os-volume_attachments => generated 194 bytes in 2985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:16.632085 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-cec7d4ee-2258-4598-905a-bd6474cee2a9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:16.632692 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cec7d4ee-2258-4598-905a-bd6474cee2a9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:16.634579 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=4 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:16.640266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cec7d4ee-2258-4598-905a-bd6474cee2a9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:16.640746 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cec7d4ee-2258-4598-905a-bd6474cee2a9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:16.641180 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cec7d4ee-2258-4598-905a-bd6474cee2a9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:16.641868 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cec7d4ee-2258-4598-905a-bd6474cee2a9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:16.642311 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cec7d4ee-2258-4598-905a-bd6474cee2a9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:16.642846 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cec7d4ee-2258-4598-905a-bd6474cee2a9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:16.784372 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cec7d4ee-2258-4598-905a-bd6474cee2a9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:16.792989 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-cec7d4ee-2258-4598-905a-bd6474cee2a9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1372 microversion: 2.1 time: 0.164924 Oct 04 08:55:16.793610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 237/432] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:16 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:16.799571 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9c959477-ddda-4b1c-a252-79a2064517b9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:16.800462 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9c959477-ddda-4b1c-a252-79a2064517b9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:16.807677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9c959477-ddda-4b1c-a252-79a2064517b9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:16.808454 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9c959477-ddda-4b1c-a252-79a2064517b9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:16.809096 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9c959477-ddda-4b1c-a252-79a2064517b9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:16.809983 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9c959477-ddda-4b1c-a252-79a2064517b9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:16.810434 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9c959477-ddda-4b1c-a252-79a2064517b9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:16.810880 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9c959477-ddda-4b1c-a252-79a2064517b9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:16.984154 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9c959477-ddda-4b1c-a252-79a2064517b9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:16.992799 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9c959477-ddda-4b1c-a252-79a2064517b9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1313 microversion: 2.1 time: 0.201129 Oct 04 08:55:16.993389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 196/433] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:16 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:17.816009 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-069ef986-a4e5-47d9-82ac-370e8d37c279 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:17.816692 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-069ef986-a4e5-47d9-82ac-370e8d37c279 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:17.822760 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-069ef986-a4e5-47d9-82ac-370e8d37c279 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:17.823227 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-069ef986-a4e5-47d9-82ac-370e8d37c279 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:17.823655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-069ef986-a4e5-47d9-82ac-370e8d37c279 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:17.824354 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-069ef986-a4e5-47d9-82ac-370e8d37c279 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:17.824791 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-069ef986-a4e5-47d9-82ac-370e8d37c279 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:17.825206 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-069ef986-a4e5-47d9-82ac-370e8d37c279 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:17.957420 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-069ef986-a4e5-47d9-82ac-370e8d37c279 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:17.961006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=100 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:17.965860 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-069ef986-a4e5-47d9-82ac-370e8d37c279 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1372 microversion: 2.1 time: 0.153741 Oct 04 08:55:17.966436 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 238/434] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:17 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:18.016873 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8fab8206-e54d-4d59-abcc-468427486991 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:18.017462 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8fab8206-e54d-4d59-abcc-468427486991 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:18.024276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8fab8206-e54d-4d59-abcc-468427486991 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:18.024762 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8fab8206-e54d-4d59-abcc-468427486991 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:18.025203 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8fab8206-e54d-4d59-abcc-468427486991 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:18.025894 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8fab8206-e54d-4d59-abcc-468427486991 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:18.026350 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8fab8206-e54d-4d59-abcc-468427486991 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:18.026807 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8fab8206-e54d-4d59-abcc-468427486991 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:18.166982 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8fab8206-e54d-4d59-abcc-468427486991 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:18.174864 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8fab8206-e54d-4d59-abcc-468427486991 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1313 microversion: 2.1 time: 0.161890 Oct 04 08:55:18.175438 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 197/435] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:18 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:18.989644 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ad67f5e8-458b-45df-96b6-ef04a969bf08 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:18.990259 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ad67f5e8-458b-45df-96b6-ef04a969bf08 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:18.997294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ad67f5e8-458b-45df-96b6-ef04a969bf08 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:18.997786 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ad67f5e8-458b-45df-96b6-ef04a969bf08 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:18.998221 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ad67f5e8-458b-45df-96b6-ef04a969bf08 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:18.998941 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ad67f5e8-458b-45df-96b6-ef04a969bf08 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:18.999415 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ad67f5e8-458b-45df-96b6-ef04a969bf08 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:18.999836 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ad67f5e8-458b-45df-96b6-ef04a969bf08 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:19.063556 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-797e8ce0-6060-410d-98cb-99084e62a6fd req-3719f8a4-603a-4086-b8d2-2156e0311eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d747a410-d796-4b53-85d5-6bc7ef085851", "name": "network-vif-plugged", "status": "completed", "tag": "75354e64-e7e8-401b-9575-247c3db9f79e"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:19.075031 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-797e8ce0-6060-410d-98cb-99084e62a6fd req-3719f8a4-603a-4086-b8d2-2156e0311eb1 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:19.078730 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-797e8ce0-6060-410d-98cb-99084e62a6fd req-3719f8a4-603a-4086-b8d2-2156e0311eb1 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:19.078730 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-797e8ce0-6060-410d-98cb-99084e62a6fd req-3719f8a4-603a-4086-b8d2-2156e0311eb1 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:19.091800 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-797e8ce0-6060-410d-98cb-99084e62a6fd req-3719f8a4-603a-4086-b8d2-2156e0311eb1 service nova] Creating event network-vif-plugged:75354e64-e7e8-401b-9575-247c3db9f79e for instance d747a410-d796-4b53-85d5-6bc7ef085851 on hv-cinder-84456 Oct 04 08:55:19.098647 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-797e8ce0-6060-410d-98cb-99084e62a6fd req-3719f8a4-603a-4086-b8d2-2156e0311eb1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038645 Oct 04 08:55:19.099251 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 198/436] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:19.198805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6e042e32-5db2-4610-860e-3784839fa7e5 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:19.199498 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6e042e32-5db2-4610-860e-3784839fa7e5 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:19.206146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6e042e32-5db2-4610-860e-3784839fa7e5 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:19.206674 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6e042e32-5db2-4610-860e-3784839fa7e5 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:19.207141 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6e042e32-5db2-4610-860e-3784839fa7e5 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:19.207849 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6e042e32-5db2-4610-860e-3784839fa7e5 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:19.208366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6e042e32-5db2-4610-860e-3784839fa7e5 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:19.208794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6e042e32-5db2-4610-860e-3784839fa7e5 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:19.402317 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ad67f5e8-458b-45df-96b6-ef04a969bf08 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:19.414197 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ad67f5e8-458b-45df-96b6-ef04a969bf08 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1566 microversion: 2.1 time: 0.429021 Oct 04 08:55:19.415349 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 239/437] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:18 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1566 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:19.440920 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6e042e32-5db2-4610-860e-3784839fa7e5 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:19.445314 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f46e7cdd-624c-4d9d-bd31-ec920d324a61 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:19.446312 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f46e7cdd-624c-4d9d-bd31-ec920d324a61 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:19.450451 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6e042e32-5db2-4610-860e-3784839fa7e5 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1313 microversion: 2.1 time: 0.255497 Oct 04 08:55:19.451188 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 199/438] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:19 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:19.453588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f46e7cdd-624c-4d9d-bd31-ec920d324a61 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:19.454075 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f46e7cdd-624c-4d9d-bd31-ec920d324a61 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:19.454505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f46e7cdd-624c-4d9d-bd31-ec920d324a61 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:19.455202 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f46e7cdd-624c-4d9d-bd31-ec920d324a61 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:19.460337 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f46e7cdd-624c-4d9d-bd31-ec920d324a61 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:19.460915 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f46e7cdd-624c-4d9d-bd31-ec920d324a61 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:19.549786 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f46e7cdd-624c-4d9d-bd31-ec920d324a61 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115658 Oct 04 08:55:19.550893 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 240/439] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Oct 4 08:55:19 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:55:20.476340 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-7e6bc56a-a421-425c-8b4b-0ce4a0167ea3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:20.477040 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-7e6bc56a-a421-425c-8b4b-0ce4a0167ea3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:20.483980 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7e6bc56a-a421-425c-8b4b-0ce4a0167ea3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:20.484557 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7e6bc56a-a421-425c-8b4b-0ce4a0167ea3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:20.485054 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7e6bc56a-a421-425c-8b4b-0ce4a0167ea3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:20.485811 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7e6bc56a-a421-425c-8b4b-0ce4a0167ea3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:20.486261 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7e6bc56a-a421-425c-8b4b-0ce4a0167ea3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:20.486731 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7e6bc56a-a421-425c-8b4b-0ce4a0167ea3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:20.545412 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-42c0d4c3-7888-4c82-94a1-6ee554da51b5 req-6cfbecd9-a078-40e7-a144-e4c374d434b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d4e170-63f9-4fa3-858f-9be84ff18613", "tag": "f3fc8c79-adbb-46ec-b7f3-b0d7539f5735"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:20.554794 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-42c0d4c3-7888-4c82-94a1-6ee554da51b5 req-6cfbecd9-a078-40e7-a144-e4c374d434b7 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:20.555386 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-42c0d4c3-7888-4c82-94a1-6ee554da51b5 req-6cfbecd9-a078-40e7-a144-e4c374d434b7 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:20.555814 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-42c0d4c3-7888-4c82-94a1-6ee554da51b5 req-6cfbecd9-a078-40e7-a144-e4c374d434b7 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:20.574307 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-42c0d4c3-7888-4c82-94a1-6ee554da51b5 req-6cfbecd9-a078-40e7-a144-e4c374d434b7 service nova] Creating event network-changed:f3fc8c79-adbb-46ec-b7f3-b0d7539f5735 for instance e8d4e170-63f9-4fa3-858f-9be84ff18613 on hv-cinder-84456 Oct 04 08:55:20.582239 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-42c0d4c3-7888-4c82-94a1-6ee554da51b5 req-6cfbecd9-a078-40e7-a144-e4c374d434b7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040395 Oct 04 08:55:20.583421 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 241/440] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:20.637066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7e6bc56a-a421-425c-8b4b-0ce4a0167ea3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:20.644885 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-7e6bc56a-a421-425c-8b4b-0ce4a0167ea3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1313 microversion: 2.1 time: 0.172580 Oct 04 08:55:20.645540 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 200/441] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:20 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:21.665397 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=16 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:21.670465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d5180645-58e4-491d-96c3-4c1695d28eb6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:21.671324 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d5180645-58e4-491d-96c3-4c1695d28eb6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:21.678698 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5180645-58e4-491d-96c3-4c1695d28eb6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:21.679172 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5180645-58e4-491d-96c3-4c1695d28eb6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:21.679598 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5180645-58e4-491d-96c3-4c1695d28eb6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:21.680324 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5180645-58e4-491d-96c3-4c1695d28eb6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:21.680763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5180645-58e4-491d-96c3-4c1695d28eb6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:21.681638 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5180645-58e4-491d-96c3-4c1695d28eb6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:21.821587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d5180645-58e4-491d-96c3-4c1695d28eb6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:21.833063 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d5180645-58e4-491d-96c3-4c1695d28eb6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1313 microversion: 2.1 time: 0.168210 Oct 04 08:55:21.833834 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 242/442] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:21 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:22.857124 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d74562ab-74f3-40dc-90a9-19d345b879ef tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:22.857661 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d74562ab-74f3-40dc-90a9-19d345b879ef tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:22.865105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d74562ab-74f3-40dc-90a9-19d345b879ef tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:22.865610 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d74562ab-74f3-40dc-90a9-19d345b879ef tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:22.866043 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d74562ab-74f3-40dc-90a9-19d345b879ef tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:22.866748 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d74562ab-74f3-40dc-90a9-19d345b879ef tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:22.867196 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d74562ab-74f3-40dc-90a9-19d345b879ef tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:22.867616 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d74562ab-74f3-40dc-90a9-19d345b879ef tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:22.998914 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d74562ab-74f3-40dc-90a9-19d345b879ef tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:23.007016 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d74562ab-74f3-40dc-90a9-19d345b879ef tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1496 microversion: 2.1 time: 0.153901 Oct 04 08:55:23.007579 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 201/443] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:22 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1496 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:23.450543 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e2587f71-e1bd-40ae-a680-28c1b68793a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:23.450996 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e2587f71-e1bd-40ae-a680-28c1b68793a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:23.457597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e2587f71-e1bd-40ae-a680-28c1b68793a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.458085 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e2587f71-e1bd-40ae-a680-28c1b68793a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.458528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e2587f71-e1bd-40ae-a680-28c1b68793a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.459249 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e2587f71-e1bd-40ae-a680-28c1b68793a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.459699 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e2587f71-e1bd-40ae-a680-28c1b68793a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.460367 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e2587f71-e1bd-40ae-a680-28c1b68793a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.484601 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e2587f71-e1bd-40ae-a680-28c1b68793a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/ips" status: 200 len: 151 microversion: 2.20 time: 0.038932 Oct 04 08:55:23.485216 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 243/444] 10.222.0.44 () {60 vars in 1289 bytes} [Tue Oct 4 08:55:23 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:55:23.626468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-7e12e101-6d04-4f24-ba64-4fa1f3835cdc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:23.626967 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-7e12e101-6d04-4f24-ba64-4fa1f3835cdc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:23.633280 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7e12e101-6d04-4f24-ba64-4fa1f3835cdc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.633762 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7e12e101-6d04-4f24-ba64-4fa1f3835cdc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.634187 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7e12e101-6d04-4f24-ba64-4fa1f3835cdc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.634955 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7e12e101-6d04-4f24-ba64-4fa1f3835cdc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.635578 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7e12e101-6d04-4f24-ba64-4fa1f3835cdc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.636139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7e12e101-6d04-4f24-ba64-4fa1f3835cdc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.664389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-7e12e101-6d04-4f24-ba64-4fa1f3835cdc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Going to try to terminate instance {{(pid=142439) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:55:23.691358 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:23.754171 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-7e12e101-6d04-4f24-ba64-4fa1f3835cdc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 204 len: 0 microversion: 2.1 time: 0.127527 Oct 04 08:55:23.754171 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 202/445] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 08:55:23 2022] DELETE /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:55:23.759480 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6ac86098-a505-4415-a231-8c0ac7f8d062 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:23.760190 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6ac86098-a505-4415-a231-8c0ac7f8d062 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:23.766959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6ac86098-a505-4415-a231-8c0ac7f8d062 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.768617 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6ac86098-a505-4415-a231-8c0ac7f8d062 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.768617 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6ac86098-a505-4415-a231-8c0ac7f8d062 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.768962 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6ac86098-a505-4415-a231-8c0ac7f8d062 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.769497 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6ac86098-a505-4415-a231-8c0ac7f8d062 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.769968 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6ac86098-a505-4415-a231-8c0ac7f8d062 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.921794 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6ac86098-a505-4415-a231-8c0ac7f8d062 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:23.930378 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6ac86098-a505-4415-a231-8c0ac7f8d062 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1502 microversion: 2.1 time: 0.175291 Oct 04 08:55:23.930979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 244/446] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:23 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:24.954783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-3cfa0c97-f7a2-4352-9764-174b7647ded3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:24.955512 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-3cfa0c97-f7a2-4352-9764-174b7647ded3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:24.962552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3cfa0c97-f7a2-4352-9764-174b7647ded3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:24.963038 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3cfa0c97-f7a2-4352-9764-174b7647ded3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:24.963474 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3cfa0c97-f7a2-4352-9764-174b7647ded3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:24.964212 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3cfa0c97-f7a2-4352-9764-174b7647ded3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:24.964664 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3cfa0c97-f7a2-4352-9764-174b7647ded3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:24.965095 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3cfa0c97-f7a2-4352-9764-174b7647ded3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:25.102317 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-3cfa0c97-f7a2-4352-9764-174b7647ded3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:25.110989 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-3cfa0c97-f7a2-4352-9764-174b7647ded3 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1502 microversion: 2.1 time: 0.160714 Oct 04 08:55:25.111598 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 203/447] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:24 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:25.715377 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c71c719a-cdf3-4ab0-ae70-7895d100f5a0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:25.715958 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c71c719a-cdf3-4ab0-ae70-7895d100f5a0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:25.722359 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c71c719a-cdf3-4ab0-ae70-7895d100f5a0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:25.722846 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c71c719a-cdf3-4ab0-ae70-7895d100f5a0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:25.723277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c71c719a-cdf3-4ab0-ae70-7895d100f5a0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:25.723998 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c71c719a-cdf3-4ab0-ae70-7895d100f5a0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:25.724454 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c71c719a-cdf3-4ab0-ae70-7895d100f5a0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:25.724877 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c71c719a-cdf3-4ab0-ae70-7895d100f5a0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:25.749093 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-c71c719a-cdf3-4ab0-ae70-7895d100f5a0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lazy-loading 'flavor' on Instance uuid f4454abc-67a9-470b-bdce-5a69bc51bbed {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:55:25.974730 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c71c719a-cdf3-4ab0-ae70-7895d100f5a0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "POST /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/action" status: 202 len: 0 microversion: 2.20 time: 0.263274 Oct 04 08:55:25.975342 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 245/448] 10.222.0.44 () {62 vars in 1319 bytes} [Tue Oct 4 08:55:25 2022] POST /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:55:25.986545 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-df8c25eb-e63d-4965-a8b5-6f2c0a2eb9f5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:25.987272 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-df8c25eb-e63d-4965-a8b5-6f2c0a2eb9f5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:25.997658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-df8c25eb-e63d-4965-a8b5-6f2c0a2eb9f5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:25.998138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-df8c25eb-e63d-4965-a8b5-6f2c0a2eb9f5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:25.998568 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-df8c25eb-e63d-4965-a8b5-6f2c0a2eb9f5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:25.999254 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-df8c25eb-e63d-4965-a8b5-6f2c0a2eb9f5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:25.999732 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-df8c25eb-e63d-4965-a8b5-6f2c0a2eb9f5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:26.000173 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-df8c25eb-e63d-4965-a8b5-6f2c0a2eb9f5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:26.137181 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f367c3bc-7aed-436d-b48c-efe53f620366 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:26.138003 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f367c3bc-7aed-436d-b48c-efe53f620366 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:26.141910 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-df8c25eb-e63d-4965-a8b5-6f2c0a2eb9f5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:26.146260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f367c3bc-7aed-436d-b48c-efe53f620366 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:26.146767 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f367c3bc-7aed-436d-b48c-efe53f620366 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:26.147198 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f367c3bc-7aed-436d-b48c-efe53f620366 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:26.147971 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f367c3bc-7aed-436d-b48c-efe53f620366 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:26.148390 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f367c3bc-7aed-436d-b48c-efe53f620366 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:26.149305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f367c3bc-7aed-436d-b48c-efe53f620366 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:26.151730 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-df8c25eb-e63d-4965-a8b5-6f2c0a2eb9f5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:26.153289 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-df8c25eb-e63d-4965-a8b5-6f2c0a2eb9f5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:26.154507 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-df8c25eb-e63d-4965-a8b5-6f2c0a2eb9f5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.174438 Oct 04 08:55:26.155086 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 204/449] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:25 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:26.291417 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f367c3bc-7aed-436d-b48c-efe53f620366 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:26.299133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f367c3bc-7aed-436d-b48c-efe53f620366 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1502 microversion: 2.1 time: 0.167277 Oct 04 08:55:26.299693 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 246/450] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:26 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:27.183744 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-23dacc0a-48b1-444a-957e-64dd6f632965 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:27.184350 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-23dacc0a-48b1-444a-957e-64dd6f632965 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:27.194016 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-23dacc0a-48b1-444a-957e-64dd6f632965 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:27.194693 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-23dacc0a-48b1-444a-957e-64dd6f632965 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:27.195199 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-23dacc0a-48b1-444a-957e-64dd6f632965 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:27.195933 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-23dacc0a-48b1-444a-957e-64dd6f632965 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:27.196598 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-23dacc0a-48b1-444a-957e-64dd6f632965 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:27.197152 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-23dacc0a-48b1-444a-957e-64dd6f632965 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:27.323044 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-defeb3c1-72bf-4691-8df0-c0c14e86eccb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:27.324452 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-defeb3c1-72bf-4691-8df0-c0c14e86eccb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:27.331124 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-defeb3c1-72bf-4691-8df0-c0c14e86eccb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:27.331874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-defeb3c1-72bf-4691-8df0-c0c14e86eccb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:27.332679 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-defeb3c1-72bf-4691-8df0-c0c14e86eccb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:27.333947 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-defeb3c1-72bf-4691-8df0-c0c14e86eccb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:27.334608 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-defeb3c1-72bf-4691-8df0-c0c14e86eccb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:27.335237 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-defeb3c1-72bf-4691-8df0-c0c14e86eccb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:27.341573 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-23dacc0a-48b1-444a-957e-64dd6f632965 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:27.350797 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-23dacc0a-48b1-444a-957e-64dd6f632965 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:27.352458 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-23dacc0a-48b1-444a-957e-64dd6f632965 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:27.353840 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-23dacc0a-48b1-444a-957e-64dd6f632965 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.176568 Oct 04 08:55:27.354460 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 205/451] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:27 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:27.478231 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-defeb3c1-72bf-4691-8df0-c0c14e86eccb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:27.486631 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-defeb3c1-72bf-4691-8df0-c0c14e86eccb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1502 microversion: 2.1 time: 0.167867 Oct 04 08:55:27.487199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 247/452] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:27 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:27.759108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-3f13d232-7de2-4f77-a14c-be74d3847317 req-b8127644-dcf9-4e3d-9cc2-0458f806f561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d747a410-d796-4b53-85d5-6bc7ef085851", "name": "network-vif-deleted", "tag": "75354e64-e7e8-401b-9575-247c3db9f79e"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:27.768778 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-3f13d232-7de2-4f77-a14c-be74d3847317 req-b8127644-dcf9-4e3d-9cc2-0458f806f561 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:27.769252 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-3f13d232-7de2-4f77-a14c-be74d3847317 req-b8127644-dcf9-4e3d-9cc2-0458f806f561 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:27.769681 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-3f13d232-7de2-4f77-a14c-be74d3847317 req-b8127644-dcf9-4e3d-9cc2-0458f806f561 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:27.780852 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-3f13d232-7de2-4f77-a14c-be74d3847317 req-b8127644-dcf9-4e3d-9cc2-0458f806f561 service nova] Creating event network-vif-deleted:75354e64-e7e8-401b-9575-247c3db9f79e for instance d747a410-d796-4b53-85d5-6bc7ef085851 on hv-cinder-84456 Oct 04 08:55:27.785657 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-3f13d232-7de2-4f77-a14c-be74d3847317 req-b8127644-dcf9-4e3d-9cc2-0458f806f561 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030361 Oct 04 08:55:27.786278 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 206/453] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:28.381910 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f38fceec-1a11-4523-855c-3b52c31031e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:28.382756 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f38fceec-1a11-4523-855c-3b52c31031e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:28.389075 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f38fceec-1a11-4523-855c-3b52c31031e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:28.389638 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f38fceec-1a11-4523-855c-3b52c31031e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:28.390195 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f38fceec-1a11-4523-855c-3b52c31031e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:28.390955 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f38fceec-1a11-4523-855c-3b52c31031e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:28.391476 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f38fceec-1a11-4523-855c-3b52c31031e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:28.391998 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f38fceec-1a11-4523-855c-3b52c31031e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:28.510614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c4bf3c06-2d52-4d34-8ba3-7ef155d8b69d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:28.511475 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c4bf3c06-2d52-4d34-8ba3-7ef155d8b69d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:28.517841 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c4bf3c06-2d52-4d34-8ba3-7ef155d8b69d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:28.518314 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c4bf3c06-2d52-4d34-8ba3-7ef155d8b69d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:28.518737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c4bf3c06-2d52-4d34-8ba3-7ef155d8b69d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:28.519477 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c4bf3c06-2d52-4d34-8ba3-7ef155d8b69d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:28.519919 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c4bf3c06-2d52-4d34-8ba3-7ef155d8b69d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:28.520346 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c4bf3c06-2d52-4d34-8ba3-7ef155d8b69d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:28.524985 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f38fceec-1a11-4523-855c-3b52c31031e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:28.533496 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f38fceec-1a11-4523-855c-3b52c31031e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:28.534902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f38fceec-1a11-4523-855c-3b52c31031e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:28.536377 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f38fceec-1a11-4523-855c-3b52c31031e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.158579 Oct 04 08:55:28.537039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 248/454] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:28 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:28.551461 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c4bf3c06-2d52-4d34-8ba3-7ef155d8b69d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:28.551861 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c4bf3c06-2d52-4d34-8ba3-7ef155d8b69d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:28.552316 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c4bf3c06-2d52-4d34-8ba3-7ef155d8b69d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:28.552760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-c4bf3c06-2d52-4d34-8ba3-7ef155d8b69d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lazy-loading 'fault' on Instance uuid d747a410-d796-4b53-85d5-6bc7ef085851 {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:55:28.600411 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c4bf3c06-2d52-4d34-8ba3-7ef155d8b69d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:28.609524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c4bf3c06-2d52-4d34-8ba3-7ef155d8b69d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 200 len: 1303 microversion: 2.1 time: 0.103455 Oct 04 08:55:28.610121 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 207/455] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:28 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:29.565266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2f855cd8-a021-4061-a1d0-40cd9f6d84bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:29.566227 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2f855cd8-a021-4061-a1d0-40cd9f6d84bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:29.576791 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2f855cd8-a021-4061-a1d0-40cd9f6d84bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:29.577250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2f855cd8-a021-4061-a1d0-40cd9f6d84bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:29.577707 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2f855cd8-a021-4061-a1d0-40cd9f6d84bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:29.578553 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2f855cd8-a021-4061-a1d0-40cd9f6d84bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:29.579059 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2f855cd8-a021-4061-a1d0-40cd9f6d84bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:29.579411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2f855cd8-a021-4061-a1d0-40cd9f6d84bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:29.637175 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6fc6e5ca-6551-46a0-8d52-7b48a3e90b49 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:29.637896 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6fc6e5ca-6551-46a0-8d52-7b48a3e90b49 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: d747a410-d796-4b53-85d5-6bc7ef085851] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:29.644779 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6fc6e5ca-6551-46a0-8d52-7b48a3e90b49 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:29.645462 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6fc6e5ca-6551-46a0-8d52-7b48a3e90b49 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:29.645885 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6fc6e5ca-6551-46a0-8d52-7b48a3e90b49 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:29.646564 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6fc6e5ca-6551-46a0-8d52-7b48a3e90b49 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:29.647012 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6fc6e5ca-6551-46a0-8d52-7b48a3e90b49 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:29.647427 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6fc6e5ca-6551-46a0-8d52-7b48a3e90b49 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:29.660795 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-6fc6e5ca-6551-46a0-8d52-7b48a3e90b49 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] HTTP exception thrown: Instance d747a410-d796-4b53-85d5-6bc7ef085851 could not be found. Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6fc6e5ca-6551-46a0-8d52-7b48a3e90b49 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Request method failure captured: Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 HTTP/1.1 Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_Tm__ubuwzp09Uu_WZ0KTVlWGI0Ddcg7ntijLdrSdGD70HnMzi-KjTue44FUX7YetAfwcXVtUYwA6fO_j-dBAl1tCsptSYzPChF-JtOTbiIV74yO_IB8xz4jGENegBMmzO9IN9BN9wdKYHCQ5rr3n2f-meJSOIHFUybVgoPIIDqWZ0 Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: d66d40b700e242eebfd51f2469879a3a Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-VolumesActionsTest-311248168 Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 08:55:29.662456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 08:55:29.664066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d66d40b700e242eebfd51f2469879a3a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d66d40b700e242eebfd51f2469879a3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d66d40b700e242eebfd51f2469879a3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d66d40b700e242eebfd51f2469879a3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:55:29.664066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-VolumesActionsTest-311248168 Oct 04 08:55:29.664066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: d66d40b700e242eebfd51f2469879a3a Oct 04 08:55:29.664066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-VolumesActionsTest-311248168 Oct 04 08:55:29.664066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-VolumesActionsTest-311248168-project Oct 04 08:55:29.664066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 08:55:29.664066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 08:55:29.664066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 3b636220f1dd443eacdeb3f975736dfc Oct 04 08:55:29.664066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-VolumesActionsTest-311248168-project Oct 04 08:55:29.664066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 08:55:29.664066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance d747a410-d796-4b53-85d5-6bc7ef085851 could not be found. Oct 04 08:55:29.664066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': 'd747a410-d796-4b53-85d5-6bc7ef085851'} Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d747a410-d796-4b53-85d5-6bc7ef085851 could not be found. Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:55:29.664951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d747a410-d796-4b53-85d5-6bc7ef085851 could not be found. Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d747a410-d796-4b53-85d5-6bc7ef085851 could not be found. Oct 04 08:55:29.666452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:55:29.667786 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6fc6e5ca-6551-46a0-8d52-7b48a3e90b49 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Returning 404 to user: Instance d747a410-d796-4b53-85d5-6bc7ef085851 could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:55:29.667786 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6fc6e5ca-6551-46a0-8d52-7b48a3e90b49 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851" status: 404 len: 111 microversion: 2.1 time: 0.030782 Oct 04 08:55:29.667786 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 208/456] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:29 2022] GET /compute/v2.1/servers/d747a410-d796-4b53-85d5-6bc7ef085851 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:55:29.716309 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2f855cd8-a021-4061-a1d0-40cd9f6d84bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:29.725023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2f855cd8-a021-4061-a1d0-40cd9f6d84bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:29.726522 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2f855cd8-a021-4061-a1d0-40cd9f6d84bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:29.727766 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2f855cd8-a021-4061-a1d0-40cd9f6d84bf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.169065 Oct 04 08:55:29.728436 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 249/457] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:29 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:29.767272 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-882142445", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "networks": [{"uuid": "5be304a6-e77b-4f6e-a85c-032512625b32"}]}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:29.823175 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.network.neutron [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] validate_networks() for [('5be304a6-e77b-4f6e-a85c-032512625b32', None, None, None, None, None)] {{(pid=142439) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:55:30.170178 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Flavor limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:55:30.170621 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Image limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:55:30.171104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Flavor pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:55:30.171502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Image pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:55:30.171911 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:55:30.174023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:30.182842 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:30.183390 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:30.183824 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:30.184568 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:30.185049 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:30.185706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:30.203066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Getting quotas for project d66d40b700e242eebfd51f2469879a3a. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:55:30.206977 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Getting quotas for user 3b636220f1dd443eacdeb3f975736dfc and project d66d40b700e242eebfd51f2469879a3a. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:55:30.217957 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Going to run 1 instances... {{(pid=142439) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:55:30.220380 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:55:30.268027 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4b1ba2b6-da12-40c0-8bfc-234462fcdfd9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504598 Oct 04 08:55:30.268732 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 209/458] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 08:55:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:55:30.279873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-04d68038-b731-42ad-940c-e348659f80ba tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:30.280506 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-04d68038-b731-42ad-940c-e348659f80ba tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:30.333210 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-04d68038-b731-42ad-940c-e348659f80ba tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:30.340327 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-04d68038-b731-42ad-940c-e348659f80ba tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1213 microversion: 2.1 time: 0.064254 Oct 04 08:55:30.340880 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 250/459] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:30 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:30.758395 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0793d8bf-649d-466d-9a7c-1d6e760756a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:30.759317 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0793d8bf-649d-466d-9a7c-1d6e760756a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:30.770295 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0793d8bf-649d-466d-9a7c-1d6e760756a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:30.771090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0793d8bf-649d-466d-9a7c-1d6e760756a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:30.771813 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0793d8bf-649d-466d-9a7c-1d6e760756a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:30.773024 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0793d8bf-649d-466d-9a7c-1d6e760756a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:30.773763 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0793d8bf-649d-466d-9a7c-1d6e760756a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:30.774462 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0793d8bf-649d-466d-9a7c-1d6e760756a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:30.919320 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0793d8bf-649d-466d-9a7c-1d6e760756a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:30.927992 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0793d8bf-649d-466d-9a7c-1d6e760756a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:30.929514 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0793d8bf-649d-466d-9a7c-1d6e760756a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:30.930556 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0793d8bf-649d-466d-9a7c-1d6e760756a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.179760 Oct 04 08:55:30.931106 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 210/460] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:30 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:31.367456 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4e83a404-d50e-459a-a1e2-97afde308607 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:31.368706 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4e83a404-d50e-459a-a1e2-97afde308607 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:31.376124 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e83a404-d50e-459a-a1e2-97afde308607 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:31.376611 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e83a404-d50e-459a-a1e2-97afde308607 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:31.377035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e83a404-d50e-459a-a1e2-97afde308607 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:31.377939 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e83a404-d50e-459a-a1e2-97afde308607 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:31.378383 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e83a404-d50e-459a-a1e2-97afde308607 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:31.378882 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e83a404-d50e-459a-a1e2-97afde308607 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:31.454850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4e83a404-d50e-459a-a1e2-97afde308607 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:31.462442 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4e83a404-d50e-459a-a1e2-97afde308607 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1217 microversion: 2.1 time: 0.102273 Oct 04 08:55:31.462967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 251/461] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:31 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:31.960565 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-7395b419-daed-49dd-9d4d-9285d5b6e47a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:31.961525 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-7395b419-daed-49dd-9d4d-9285d5b6e47a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:31.969792 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7395b419-daed-49dd-9d4d-9285d5b6e47a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:31.970280 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7395b419-daed-49dd-9d4d-9285d5b6e47a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:31.970702 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7395b419-daed-49dd-9d4d-9285d5b6e47a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:31.971417 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7395b419-daed-49dd-9d4d-9285d5b6e47a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:31.971865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7395b419-daed-49dd-9d4d-9285d5b6e47a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:31.972725 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7395b419-daed-49dd-9d4d-9285d5b6e47a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:32.099822 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7395b419-daed-49dd-9d4d-9285d5b6e47a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:32.108080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7395b419-daed-49dd-9d4d-9285d5b6e47a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:32.109502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7395b419-daed-49dd-9d4d-9285d5b6e47a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:32.110799 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-7395b419-daed-49dd-9d4d-9285d5b6e47a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.156984 Oct 04 08:55:32.111354 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 211/462] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:31 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:32.486083 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8e191d58-fdae-4101-b12f-fb903081d132 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:32.486686 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8e191d58-fdae-4101-b12f-fb903081d132 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:32.493372 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e191d58-fdae-4101-b12f-fb903081d132 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:32.493850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e191d58-fdae-4101-b12f-fb903081d132 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:32.494273 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e191d58-fdae-4101-b12f-fb903081d132 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:32.494950 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e191d58-fdae-4101-b12f-fb903081d132 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:32.495395 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e191d58-fdae-4101-b12f-fb903081d132 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:32.495927 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e191d58-fdae-4101-b12f-fb903081d132 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:32.560795 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8e191d58-fdae-4101-b12f-fb903081d132 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:32.568746 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8e191d58-fdae-4101-b12f-fb903081d132 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1217 microversion: 2.1 time: 0.086661 Oct 04 08:55:32.569591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 252/463] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:32 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:33.141189 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-bfd80ecd-3e56-442b-8ead-0ecceb9c89de tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:33.142191 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-bfd80ecd-3e56-442b-8ead-0ecceb9c89de tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:33.153090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bfd80ecd-3e56-442b-8ead-0ecceb9c89de tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:33.153914 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bfd80ecd-3e56-442b-8ead-0ecceb9c89de tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:33.154629 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bfd80ecd-3e56-442b-8ead-0ecceb9c89de tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:33.155748 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bfd80ecd-3e56-442b-8ead-0ecceb9c89de tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:33.156528 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bfd80ecd-3e56-442b-8ead-0ecceb9c89de tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:33.157235 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bfd80ecd-3e56-442b-8ead-0ecceb9c89de tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:33.303561 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-bfd80ecd-3e56-442b-8ead-0ecceb9c89de tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:33.311774 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-bfd80ecd-3e56-442b-8ead-0ecceb9c89de tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:33.313224 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-bfd80ecd-3e56-442b-8ead-0ecceb9c89de tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:33.314377 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-bfd80ecd-3e56-442b-8ead-0ecceb9c89de tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.179919 Oct 04 08:55:33.314930 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 212/464] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:33 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:33.596085 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-3ae692eb-9a33-48b2-9230-f7af2dc72f0b tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:33.597105 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-3ae692eb-9a33-48b2-9230-f7af2dc72f0b tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:33.607366 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3ae692eb-9a33-48b2-9230-f7af2dc72f0b tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:33.608227 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3ae692eb-9a33-48b2-9230-f7af2dc72f0b tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:33.608944 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3ae692eb-9a33-48b2-9230-f7af2dc72f0b tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:33.610059 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3ae692eb-9a33-48b2-9230-f7af2dc72f0b tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:33.610791 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3ae692eb-9a33-48b2-9230-f7af2dc72f0b tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:33.611478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3ae692eb-9a33-48b2-9230-f7af2dc72f0b tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:33.676376 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3ae692eb-9a33-48b2-9230-f7af2dc72f0b tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:33.684631 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-3ae692eb-9a33-48b2-9230-f7af2dc72f0b tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1217 microversion: 2.1 time: 0.095253 Oct 04 08:55:33.685197 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 253/465] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:33 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:34.342337 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ff7668fd-b6fe-4d8e-b706-4364b3e928eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:34.342921 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ff7668fd-b6fe-4d8e-b706-4364b3e928eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:34.349874 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ff7668fd-b6fe-4d8e-b706-4364b3e928eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:34.350361 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ff7668fd-b6fe-4d8e-b706-4364b3e928eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:34.350793 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ff7668fd-b6fe-4d8e-b706-4364b3e928eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:34.351480 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ff7668fd-b6fe-4d8e-b706-4364b3e928eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:34.351965 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ff7668fd-b6fe-4d8e-b706-4364b3e928eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:34.352389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ff7668fd-b6fe-4d8e-b706-4364b3e928eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:34.486064 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ff7668fd-b6fe-4d8e-b706-4364b3e928eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:34.494793 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ff7668fd-b6fe-4d8e-b706-4364b3e928eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:34.496357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ff7668fd-b6fe-4d8e-b706-4364b3e928eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:34.497544 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ff7668fd-b6fe-4d8e-b706-4364b3e928eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.160328 Oct 04 08:55:34.498243 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 213/466] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:34 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:34.707224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2fe4a174-d49e-4898-bf91-ad25dc3090e0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:34.707906 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2fe4a174-d49e-4898-bf91-ad25dc3090e0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:34.714207 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2fe4a174-d49e-4898-bf91-ad25dc3090e0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:34.714948 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2fe4a174-d49e-4898-bf91-ad25dc3090e0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:34.715194 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2fe4a174-d49e-4898-bf91-ad25dc3090e0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:34.715961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2fe4a174-d49e-4898-bf91-ad25dc3090e0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:34.716441 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2fe4a174-d49e-4898-bf91-ad25dc3090e0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:34.716864 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2fe4a174-d49e-4898-bf91-ad25dc3090e0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:34.780628 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2fe4a174-d49e-4898-bf91-ad25dc3090e0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:34.788428 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2fe4a174-d49e-4898-bf91-ad25dc3090e0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1217 microversion: 2.1 time: 0.085088 Oct 04 08:55:34.788959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 254/467] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:34 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:35.527394 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-3c88dc53-563a-4f9c-8609-a5c03baf15a9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:35.528616 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-3c88dc53-563a-4f9c-8609-a5c03baf15a9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:35.539360 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3c88dc53-563a-4f9c-8609-a5c03baf15a9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:35.540218 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3c88dc53-563a-4f9c-8609-a5c03baf15a9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:35.540925 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3c88dc53-563a-4f9c-8609-a5c03baf15a9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:35.542052 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3c88dc53-563a-4f9c-8609-a5c03baf15a9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:35.542836 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3c88dc53-563a-4f9c-8609-a5c03baf15a9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:35.543529 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3c88dc53-563a-4f9c-8609-a5c03baf15a9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:35.672067 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-3c88dc53-563a-4f9c-8609-a5c03baf15a9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:35.680762 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-3c88dc53-563a-4f9c-8609-a5c03baf15a9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:35.682223 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-3c88dc53-563a-4f9c-8609-a5c03baf15a9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:35.683368 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-3c88dc53-563a-4f9c-8609-a5c03baf15a9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.162863 Oct 04 08:55:35.683939 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 214/468] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:35 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:35.815056 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-293391f7-af7c-4641-a506-7b8aba1c2947 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:35.815711 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-293391f7-af7c-4641-a506-7b8aba1c2947 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:35.822218 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-293391f7-af7c-4641-a506-7b8aba1c2947 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:35.822700 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-293391f7-af7c-4641-a506-7b8aba1c2947 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:35.823131 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-293391f7-af7c-4641-a506-7b8aba1c2947 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:35.823817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-293391f7-af7c-4641-a506-7b8aba1c2947 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:35.824306 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-293391f7-af7c-4641-a506-7b8aba1c2947 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:35.824724 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-293391f7-af7c-4641-a506-7b8aba1c2947 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:35.887589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-293391f7-af7c-4641-a506-7b8aba1c2947 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:35.891191 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:35.896435 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-293391f7-af7c-4641-a506-7b8aba1c2947 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1217 microversion: 2.1 time: 0.085506 Oct 04 08:55:35.896999 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 255/469] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:35 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:36.709151 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-660cccc8-ff9a-499c-b9d0-886317f98f4e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:36.710376 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-660cccc8-ff9a-499c-b9d0-886317f98f4e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:36.717616 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-660cccc8-ff9a-499c-b9d0-886317f98f4e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:36.718158 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-660cccc8-ff9a-499c-b9d0-886317f98f4e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:36.718613 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-660cccc8-ff9a-499c-b9d0-886317f98f4e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:36.719298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-660cccc8-ff9a-499c-b9d0-886317f98f4e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:36.719773 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-660cccc8-ff9a-499c-b9d0-886317f98f4e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:36.720303 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-660cccc8-ff9a-499c-b9d0-886317f98f4e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:36.868288 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-660cccc8-ff9a-499c-b9d0-886317f98f4e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:36.880136 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-660cccc8-ff9a-499c-b9d0-886317f98f4e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:36.882288 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-660cccc8-ff9a-499c-b9d0-886317f98f4e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:36.883940 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-660cccc8-ff9a-499c-b9d0-886317f98f4e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.178580 Oct 04 08:55:36.884705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 215/470] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:36 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:36.919370 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-cfbe1df5-7be0-4e8f-b1f8-408bcf33e91d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:36.919978 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cfbe1df5-7be0-4e8f-b1f8-408bcf33e91d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:36.926999 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cfbe1df5-7be0-4e8f-b1f8-408bcf33e91d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:36.927676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cfbe1df5-7be0-4e8f-b1f8-408bcf33e91d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:36.927983 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cfbe1df5-7be0-4e8f-b1f8-408bcf33e91d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:36.928882 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cfbe1df5-7be0-4e8f-b1f8-408bcf33e91d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:36.929425 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cfbe1df5-7be0-4e8f-b1f8-408bcf33e91d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:36.929796 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cfbe1df5-7be0-4e8f-b1f8-408bcf33e91d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:36.994244 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cfbe1df5-7be0-4e8f-b1f8-408bcf33e91d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:37.002219 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-cfbe1df5-7be0-4e8f-b1f8-408bcf33e91d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1265 microversion: 2.1 time: 0.087558 Oct 04 08:55:37.002778 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 256/471] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:36 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:37.912006 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1a105664-0a39-408c-a6dd-6941272d485e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:37.912619 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1a105664-0a39-408c-a6dd-6941272d485e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:37.919926 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1a105664-0a39-408c-a6dd-6941272d485e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:37.920466 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1a105664-0a39-408c-a6dd-6941272d485e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:37.920904 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1a105664-0a39-408c-a6dd-6941272d485e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:37.921623 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1a105664-0a39-408c-a6dd-6941272d485e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:37.922080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1a105664-0a39-408c-a6dd-6941272d485e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:37.922547 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1a105664-0a39-408c-a6dd-6941272d485e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:38.026557 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f191a26a-7a1d-4cf3-b017-7aae157817fd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:38.027328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f191a26a-7a1d-4cf3-b017-7aae157817fd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:38.034344 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f191a26a-7a1d-4cf3-b017-7aae157817fd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:38.034851 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f191a26a-7a1d-4cf3-b017-7aae157817fd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:38.035279 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f191a26a-7a1d-4cf3-b017-7aae157817fd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:38.035999 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f191a26a-7a1d-4cf3-b017-7aae157817fd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:38.036601 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f191a26a-7a1d-4cf3-b017-7aae157817fd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:38.037017 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f191a26a-7a1d-4cf3-b017-7aae157817fd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:38.060218 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1a105664-0a39-408c-a6dd-6941272d485e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:38.067767 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1a105664-0a39-408c-a6dd-6941272d485e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:38.069272 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1a105664-0a39-408c-a6dd-6941272d485e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:38.070444 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1a105664-0a39-408c-a6dd-6941272d485e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.162544 Oct 04 08:55:38.071019 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 216/472] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:37 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:38.168503 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f191a26a-7a1d-4cf3-b017-7aae157817fd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:38.179972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f191a26a-7a1d-4cf3-b017-7aae157817fd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.157090 Oct 04 08:55:38.180842 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 257/473] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:38 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:39.095462 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2ca5a297-e17f-499f-aa46-933200c77689 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:39.096183 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2ca5a297-e17f-499f-aa46-933200c77689 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:39.103849 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ca5a297-e17f-499f-aa46-933200c77689 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:39.104441 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ca5a297-e17f-499f-aa46-933200c77689 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:39.104919 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ca5a297-e17f-499f-aa46-933200c77689 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:39.105673 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ca5a297-e17f-499f-aa46-933200c77689 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:39.106177 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ca5a297-e17f-499f-aa46-933200c77689 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:39.106621 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ca5a297-e17f-499f-aa46-933200c77689 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:39.202577 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a2eacdb6-2762-4752-a7ca-b170b33d496d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:39.203210 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a2eacdb6-2762-4752-a7ca-b170b33d496d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:39.209579 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a2eacdb6-2762-4752-a7ca-b170b33d496d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:39.210068 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a2eacdb6-2762-4752-a7ca-b170b33d496d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:39.210497 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a2eacdb6-2762-4752-a7ca-b170b33d496d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:39.211197 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a2eacdb6-2762-4752-a7ca-b170b33d496d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:39.211649 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a2eacdb6-2762-4752-a7ca-b170b33d496d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:39.212112 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a2eacdb6-2762-4752-a7ca-b170b33d496d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:39.236667 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2ca5a297-e17f-499f-aa46-933200c77689 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:39.245625 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2ca5a297-e17f-499f-aa46-933200c77689 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:39.247067 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2ca5a297-e17f-499f-aa46-933200c77689 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:39.248262 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2ca5a297-e17f-499f-aa46-933200c77689 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.157127 Oct 04 08:55:39.248825 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 217/474] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:39 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:39.342474 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-a2eacdb6-2762-4752-a7ca-b170b33d496d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:39.351225 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a2eacdb6-2762-4752-a7ca-b170b33d496d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.152506 Oct 04 08:55:39.351771 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 258/475] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:39 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:40.277439 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4b97a599-9df4-4488-a4f3-9720e7b5f498 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:40.278455 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4b97a599-9df4-4488-a4f3-9720e7b5f498 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:40.282213 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:40.282877 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=6 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:40.289072 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b97a599-9df4-4488-a4f3-9720e7b5f498 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:40.289555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b97a599-9df4-4488-a4f3-9720e7b5f498 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:40.289991 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b97a599-9df4-4488-a4f3-9720e7b5f498 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:40.290664 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b97a599-9df4-4488-a4f3-9720e7b5f498 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:40.291114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b97a599-9df4-4488-a4f3-9720e7b5f498 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:40.291536 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b97a599-9df4-4488-a4f3-9720e7b5f498 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:40.374923 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b8e0a9cb-2aa6-4e7b-8e33-48339495d608 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:40.375562 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b8e0a9cb-2aa6-4e7b-8e33-48339495d608 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:40.377613 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:40.383184 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8e0a9cb-2aa6-4e7b-8e33-48339495d608 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:40.383674 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8e0a9cb-2aa6-4e7b-8e33-48339495d608 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:40.384129 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8e0a9cb-2aa6-4e7b-8e33-48339495d608 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:40.384829 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8e0a9cb-2aa6-4e7b-8e33-48339495d608 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:40.385270 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8e0a9cb-2aa6-4e7b-8e33-48339495d608 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:40.385744 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8e0a9cb-2aa6-4e7b-8e33-48339495d608 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:40.422574 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4b97a599-9df4-4488-a4f3-9720e7b5f498 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:40.435454 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4b97a599-9df4-4488-a4f3-9720e7b5f498 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:40.437196 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4b97a599-9df4-4488-a4f3-9720e7b5f498 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:40.438930 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4b97a599-9df4-4488-a4f3-9720e7b5f498 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.168273 Oct 04 08:55:40.439593 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 218/476] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:40 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:40.528878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b8e0a9cb-2aa6-4e7b-8e33-48339495d608 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:40.540086 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b8e0a9cb-2aa6-4e7b-8e33-48339495d608 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.168901 Oct 04 08:55:40.540970 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 259/477] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:40 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:41.465020 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6f3ddea1-56de-49b7-851f-4d9c633dd5f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:41.465661 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6f3ddea1-56de-49b7-851f-4d9c633dd5f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:41.472300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6f3ddea1-56de-49b7-851f-4d9c633dd5f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:41.472782 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6f3ddea1-56de-49b7-851f-4d9c633dd5f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:41.473204 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6f3ddea1-56de-49b7-851f-4d9c633dd5f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:41.473883 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6f3ddea1-56de-49b7-851f-4d9c633dd5f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:41.474327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6f3ddea1-56de-49b7-851f-4d9c633dd5f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:41.474737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6f3ddea1-56de-49b7-851f-4d9c633dd5f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:41.562747 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-25d21394-b141-43ae-af1a-357fc7194650 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:41.563458 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-25d21394-b141-43ae-af1a-357fc7194650 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:41.570089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-25d21394-b141-43ae-af1a-357fc7194650 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:41.570577 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-25d21394-b141-43ae-af1a-357fc7194650 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:41.571007 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-25d21394-b141-43ae-af1a-357fc7194650 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:41.571699 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-25d21394-b141-43ae-af1a-357fc7194650 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:41.572163 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-25d21394-b141-43ae-af1a-357fc7194650 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:41.572612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-25d21394-b141-43ae-af1a-357fc7194650 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:41.625776 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6f3ddea1-56de-49b7-851f-4d9c633dd5f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:41.634341 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6f3ddea1-56de-49b7-851f-4d9c633dd5f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:41.635857 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6f3ddea1-56de-49b7-851f-4d9c633dd5f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:41.637115 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6f3ddea1-56de-49b7-851f-4d9c633dd5f3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.176187 Oct 04 08:55:41.638093 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 219/478] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:41 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:41.710784 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-25d21394-b141-43ae-af1a-357fc7194650 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:41.718774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-25d21394-b141-43ae-af1a-357fc7194650 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.160041 Oct 04 08:55:41.719362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 260/479] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:41 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:42.626476 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-9e23bd93-f038-4805-b46c-4044be8055f2 req-18581d32-49ca-41f8-8202-d1767918a1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3065f8-4fa3-4b25-8362-7c29c79fee76", "tag": "3609cbf8-d7b0-457d-a5c9-1e9bf12dc3b3"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:42.637808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-9e23bd93-f038-4805-b46c-4044be8055f2 req-18581d32-49ca-41f8-8202-d1767918a1a1 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:42.638736 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-9e23bd93-f038-4805-b46c-4044be8055f2 req-18581d32-49ca-41f8-8202-d1767918a1a1 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:42.639395 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-9e23bd93-f038-4805-b46c-4044be8055f2 req-18581d32-49ca-41f8-8202-d1767918a1a1 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:42.642668 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:42.654419 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-9e23bd93-f038-4805-b46c-4044be8055f2 req-18581d32-49ca-41f8-8202-d1767918a1a1 service nova] Creating event network-changed:3609cbf8-d7b0-457d-a5c9-1e9bf12dc3b3 for instance 4e3065f8-4fa3-4b25-8362-7c29c79fee76 on hv-cinder-84456 Oct 04 08:55:42.660429 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-9e23bd93-f038-4805-b46c-4044be8055f2 req-18581d32-49ca-41f8-8202-d1767918a1a1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037596 Oct 04 08:55:42.661260 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 220/480] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:42.662611 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ea354762-b263-4320-9067-8be846de44d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:42.663197 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ea354762-b263-4320-9067-8be846de44d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:42.669219 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ea354762-b263-4320-9067-8be846de44d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:42.669702 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ea354762-b263-4320-9067-8be846de44d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:42.670135 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ea354762-b263-4320-9067-8be846de44d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:42.670820 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ea354762-b263-4320-9067-8be846de44d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:42.671297 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ea354762-b263-4320-9067-8be846de44d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:42.671712 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ea354762-b263-4320-9067-8be846de44d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:42.742810 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-18c954b2-aedd-445a-88cb-838d3ae4a260 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:42.743503 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-18c954b2-aedd-445a-88cb-838d3ae4a260 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:42.750590 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-18c954b2-aedd-445a-88cb-838d3ae4a260 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:42.751167 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-18c954b2-aedd-445a-88cb-838d3ae4a260 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:42.751664 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-18c954b2-aedd-445a-88cb-838d3ae4a260 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:42.752447 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-18c954b2-aedd-445a-88cb-838d3ae4a260 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:42.752957 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-18c954b2-aedd-445a-88cb-838d3ae4a260 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:42.753442 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-18c954b2-aedd-445a-88cb-838d3ae4a260 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:42.829406 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ea354762-b263-4320-9067-8be846de44d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:42.838396 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ea354762-b263-4320-9067-8be846de44d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:42.839820 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ea354762-b263-4320-9067-8be846de44d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:42.841035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ea354762-b263-4320-9067-8be846de44d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.182565 Oct 04 08:55:42.841613 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 261/481] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:42 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:55:42.902166 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-18c954b2-aedd-445a-88cb-838d3ae4a260 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:42.910153 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-18c954b2-aedd-445a-88cb-838d3ae4a260 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.171972 Oct 04 08:55:42.910697 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 221/482] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:42 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:43.872308 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-16fa7198-51fa-4603-8eaa-1ffba6c9bd08 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:43.872996 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-16fa7198-51fa-4603-8eaa-1ffba6c9bd08 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:43.879811 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16fa7198-51fa-4603-8eaa-1ffba6c9bd08 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:43.880645 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16fa7198-51fa-4603-8eaa-1ffba6c9bd08 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:43.881222 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16fa7198-51fa-4603-8eaa-1ffba6c9bd08 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:43.882099 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16fa7198-51fa-4603-8eaa-1ffba6c9bd08 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:43.882530 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16fa7198-51fa-4603-8eaa-1ffba6c9bd08 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:43.882940 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16fa7198-51fa-4603-8eaa-1ffba6c9bd08 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:43.933094 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a184dce3-f366-4047-a4bc-16afde0baddd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:43.934356 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a184dce3-f366-4047-a4bc-16afde0baddd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:43.942249 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a184dce3-f366-4047-a4bc-16afde0baddd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:43.942741 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a184dce3-f366-4047-a4bc-16afde0baddd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:43.943211 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a184dce3-f366-4047-a4bc-16afde0baddd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:43.943938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a184dce3-f366-4047-a4bc-16afde0baddd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:43.944400 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a184dce3-f366-4047-a4bc-16afde0baddd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:43.949420 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a184dce3-f366-4047-a4bc-16afde0baddd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:44.073780 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-16fa7198-51fa-4603-8eaa-1ffba6c9bd08 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:44.082581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-16fa7198-51fa-4603-8eaa-1ffba6c9bd08 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:44.084053 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-16fa7198-51fa-4603-8eaa-1ffba6c9bd08 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:44.085261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-16fa7198-51fa-4603-8eaa-1ffba6c9bd08 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.217234 Oct 04 08:55:44.086055 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 262/483] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:43 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:44.103163 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a184dce3-f366-4047-a4bc-16afde0baddd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:44.111003 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a184dce3-f366-4047-a4bc-16afde0baddd tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.181735 Oct 04 08:55:44.111566 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 222/484] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:43 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:45.116405 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7245f7cc-1776-4427-86f4-bb1e18a979c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:45.117403 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7245f7cc-1776-4427-86f4-bb1e18a979c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:45.127596 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7245f7cc-1776-4427-86f4-bb1e18a979c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:45.128459 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7245f7cc-1776-4427-86f4-bb1e18a979c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:45.129165 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7245f7cc-1776-4427-86f4-bb1e18a979c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:45.130417 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7245f7cc-1776-4427-86f4-bb1e18a979c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:45.131173 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7245f7cc-1776-4427-86f4-bb1e18a979c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:45.131875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7245f7cc-1776-4427-86f4-bb1e18a979c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:45.138393 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-58ed2389-8754-4713-ab08-8fa160019d09 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:45.139388 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-58ed2389-8754-4713-ab08-8fa160019d09 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:45.147054 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-58ed2389-8754-4713-ab08-8fa160019d09 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:45.147531 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-58ed2389-8754-4713-ab08-8fa160019d09 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:45.147971 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-58ed2389-8754-4713-ab08-8fa160019d09 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:45.148658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-58ed2389-8754-4713-ab08-8fa160019d09 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:45.149103 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-58ed2389-8754-4713-ab08-8fa160019d09 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:45.149517 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-58ed2389-8754-4713-ab08-8fa160019d09 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:45.330555 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7245f7cc-1776-4427-86f4-bb1e18a979c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:45.333737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-58ed2389-8754-4713-ab08-8fa160019d09 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:45.339086 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7245f7cc-1776-4427-86f4-bb1e18a979c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:45.340643 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7245f7cc-1776-4427-86f4-bb1e18a979c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:45.341721 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-58ed2389-8754-4713-ab08-8fa160019d09 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.209769 Oct 04 08:55:45.341839 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7245f7cc-1776-4427-86f4-bb1e18a979c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.232655 Oct 04 08:55:45.342286 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 223/485] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:45 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:45.343106 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 263/486] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:45 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:46.369298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a04f0934-616a-43c4-b9c6-8f7a02a296bc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:46.370273 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a04f0934-616a-43c4-b9c6-8f7a02a296bc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:46.370812 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ac39aa08-4d7a-4816-a3e9-18b3f43e304a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:46.371810 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ac39aa08-4d7a-4816-a3e9-18b3f43e304a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:46.374747 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=60 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:46.379312 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a04f0934-616a-43c4-b9c6-8f7a02a296bc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:46.379878 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a04f0934-616a-43c4-b9c6-8f7a02a296bc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:46.380471 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac39aa08-4d7a-4816-a3e9-18b3f43e304a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:46.380585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a04f0934-616a-43c4-b9c6-8f7a02a296bc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:46.380951 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac39aa08-4d7a-4816-a3e9-18b3f43e304a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:46.381371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac39aa08-4d7a-4816-a3e9-18b3f43e304a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:46.381527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a04f0934-616a-43c4-b9c6-8f7a02a296bc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:46.381849 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a04f0934-616a-43c4-b9c6-8f7a02a296bc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:46.382059 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac39aa08-4d7a-4816-a3e9-18b3f43e304a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:46.382266 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a04f0934-616a-43c4-b9c6-8f7a02a296bc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:46.382535 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac39aa08-4d7a-4816-a3e9-18b3f43e304a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:46.382957 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac39aa08-4d7a-4816-a3e9-18b3f43e304a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:46.570626 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a04f0934-616a-43c4-b9c6-8f7a02a296bc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:46.573563 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ac39aa08-4d7a-4816-a3e9-18b3f43e304a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:46.582044 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ac39aa08-4d7a-4816-a3e9-18b3f43e304a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:46.583350 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a04f0934-616a-43c4-b9c6-8f7a02a296bc tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.221045 Oct 04 08:55:46.583510 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ac39aa08-4d7a-4816-a3e9-18b3f43e304a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:46.584076 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 224/487] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:46 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:46.584637 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ac39aa08-4d7a-4816-a3e9-18b3f43e304a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.220368 Oct 04 08:55:46.586916 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 264/488] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:46 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:47.606231 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4ec86578-f656-4814-9d25-c06064eb4642 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:47.606820 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4ec86578-f656-4814-9d25-c06064eb4642 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:47.613861 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4ec86578-f656-4814-9d25-c06064eb4642 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:47.614343 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4ec86578-f656-4814-9d25-c06064eb4642 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:47.614773 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4ec86578-f656-4814-9d25-c06064eb4642 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:47.615458 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4ec86578-f656-4814-9d25-c06064eb4642 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:47.615924 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4ec86578-f656-4814-9d25-c06064eb4642 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:47.616358 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4ec86578-f656-4814-9d25-c06064eb4642 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:47.619430 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c30e8789-2904-46c9-94dd-9e70fa45e6f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:47.620558 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c30e8789-2904-46c9-94dd-9e70fa45e6f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:47.626388 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c30e8789-2904-46c9-94dd-9e70fa45e6f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:47.626872 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c30e8789-2904-46c9-94dd-9e70fa45e6f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:47.627304 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c30e8789-2904-46c9-94dd-9e70fa45e6f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:47.628032 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c30e8789-2904-46c9-94dd-9e70fa45e6f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:47.628484 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c30e8789-2904-46c9-94dd-9e70fa45e6f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:47.628906 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c30e8789-2904-46c9-94dd-9e70fa45e6f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:47.799551 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4ec86578-f656-4814-9d25-c06064eb4642 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:47.807771 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4ec86578-f656-4814-9d25-c06064eb4642 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.205368 Oct 04 08:55:47.808398 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 225/489] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:47 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:47.813971 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c30e8789-2904-46c9-94dd-9e70fa45e6f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:47.821954 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c30e8789-2904-46c9-94dd-9e70fa45e6f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:47.823372 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c30e8789-2904-46c9-94dd-9e70fa45e6f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:47.824541 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c30e8789-2904-46c9-94dd-9e70fa45e6f0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.209640 Oct 04 08:55:47.825116 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 265/490] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:47 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:48.833409 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-37326be2-b1dc-4b37-839e-9b8e6a22ddfb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:48.834013 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-37326be2-b1dc-4b37-839e-9b8e6a22ddfb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:48.840924 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-37326be2-b1dc-4b37-839e-9b8e6a22ddfb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:48.841418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-37326be2-b1dc-4b37-839e-9b8e6a22ddfb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:48.841856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-37326be2-b1dc-4b37-839e-9b8e6a22ddfb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:48.842544 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-37326be2-b1dc-4b37-839e-9b8e6a22ddfb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:48.843032 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-37326be2-b1dc-4b37-839e-9b8e6a22ddfb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:48.843461 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-37326be2-b1dc-4b37-839e-9b8e6a22ddfb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:48.849305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b0d4d002-1ef5-413e-926a-4c002051988d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:48.849903 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b0d4d002-1ef5-413e-926a-4c002051988d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:48.856001 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b0d4d002-1ef5-413e-926a-4c002051988d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:48.856510 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b0d4d002-1ef5-413e-926a-4c002051988d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:48.856936 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b0d4d002-1ef5-413e-926a-4c002051988d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:48.857617 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b0d4d002-1ef5-413e-926a-4c002051988d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:48.858062 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b0d4d002-1ef5-413e-926a-4c002051988d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:48.858463 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b0d4d002-1ef5-413e-926a-4c002051988d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:49.040939 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-37326be2-b1dc-4b37-839e-9b8e6a22ddfb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:49.043916 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b0d4d002-1ef5-413e-926a-4c002051988d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:49.049174 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-37326be2-b1dc-4b37-839e-9b8e6a22ddfb tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.219781 Oct 04 08:55:49.049728 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 226/491] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:48 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:49.052171 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b0d4d002-1ef5-413e-926a-4c002051988d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:49.053650 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b0d4d002-1ef5-413e-926a-4c002051988d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:49.054799 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b0d4d002-1ef5-413e-926a-4c002051988d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.209461 Oct 04 08:55:49.055346 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 266/492] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:48 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:50.076422 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-3c688bb1-669e-4dee-85b7-eae4cbe5325d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:50.077422 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-3c688bb1-669e-4dee-85b7-eae4cbe5325d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:50.083134 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b85f1e1b-155e-48b1-9a55-202ab2d92e36 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:50.085156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b85f1e1b-155e-48b1-9a55-202ab2d92e36 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:50.088565 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3c688bb1-669e-4dee-85b7-eae4cbe5325d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:50.089392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3c688bb1-669e-4dee-85b7-eae4cbe5325d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:50.090117 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3c688bb1-669e-4dee-85b7-eae4cbe5325d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:50.091380 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3c688bb1-669e-4dee-85b7-eae4cbe5325d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:50.092200 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3c688bb1-669e-4dee-85b7-eae4cbe5325d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:50.092880 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3c688bb1-669e-4dee-85b7-eae4cbe5325d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:50.094925 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b85f1e1b-155e-48b1-9a55-202ab2d92e36 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:50.095409 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b85f1e1b-155e-48b1-9a55-202ab2d92e36 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:50.095834 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b85f1e1b-155e-48b1-9a55-202ab2d92e36 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:50.096523 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b85f1e1b-155e-48b1-9a55-202ab2d92e36 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:50.097002 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b85f1e1b-155e-48b1-9a55-202ab2d92e36 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:50.097402 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b85f1e1b-155e-48b1-9a55-202ab2d92e36 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:50.287760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-3c688bb1-669e-4dee-85b7-eae4cbe5325d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:50.291637 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b85f1e1b-155e-48b1-9a55-202ab2d92e36 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:50.295722 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-3c688bb1-669e-4dee-85b7-eae4cbe5325d tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.225842 Oct 04 08:55:50.296324 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 227/493] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:50 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:50.300258 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b85f1e1b-155e-48b1-9a55-202ab2d92e36 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:50.301780 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b85f1e1b-155e-48b1-9a55-202ab2d92e36 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:50.302946 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b85f1e1b-155e-48b1-9a55-202ab2d92e36 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.226325 Oct 04 08:55:50.303482 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 267/494] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:50 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:51.322206 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2cf99af7-b5e5-4859-b20e-79d2c0b15769 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:51.323196 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2cf99af7-b5e5-4859-b20e-79d2c0b15769 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:51.331956 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5a930035-b191-4737-8800-94985bb37471 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:51.333012 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5a930035-b191-4737-8800-94985bb37471 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:51.334329 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2cf99af7-b5e5-4859-b20e-79d2c0b15769 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:51.335130 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2cf99af7-b5e5-4859-b20e-79d2c0b15769 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:51.335850 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2cf99af7-b5e5-4859-b20e-79d2c0b15769 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:51.337032 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2cf99af7-b5e5-4859-b20e-79d2c0b15769 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:51.337982 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2cf99af7-b5e5-4859-b20e-79d2c0b15769 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:51.338759 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2cf99af7-b5e5-4859-b20e-79d2c0b15769 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:51.343036 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5a930035-b191-4737-8800-94985bb37471 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:51.343874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5a930035-b191-4737-8800-94985bb37471 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:51.344754 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5a930035-b191-4737-8800-94985bb37471 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:51.345444 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5a930035-b191-4737-8800-94985bb37471 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:51.345896 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5a930035-b191-4737-8800-94985bb37471 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:51.346322 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5a930035-b191-4737-8800-94985bb37471 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:51.531456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2cf99af7-b5e5-4859-b20e-79d2c0b15769 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:51.535472 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5a930035-b191-4737-8800-94985bb37471 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:51.540649 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2cf99af7-b5e5-4859-b20e-79d2c0b15769 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.225091 Oct 04 08:55:51.542437 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 228/495] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:51 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:51.544158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5a930035-b191-4737-8800-94985bb37471 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:51.545650 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5a930035-b191-4737-8800-94985bb37471 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:51.547024 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5a930035-b191-4737-8800-94985bb37471 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.221594 Oct 04 08:55:51.547692 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 268/496] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:51 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:52.567088 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-608a7182-0ea8-4627-8ea4-8f20ace5c0db tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:52.568023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-608a7182-0ea8-4627-8ea4-8f20ace5c0db tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:52.575305 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-608a7182-0ea8-4627-8ea4-8f20ace5c0db tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:52.576114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-608a7182-0ea8-4627-8ea4-8f20ace5c0db tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:52.576552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-608a7182-0ea8-4627-8ea4-8f20ace5c0db tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:52.577252 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-608a7182-0ea8-4627-8ea4-8f20ace5c0db tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:52.577709 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-608a7182-0ea8-4627-8ea4-8f20ace5c0db tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:52.577855 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-63450de9-7a44-4661-b1cc-d4c98b62f0c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:52.578332 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-608a7182-0ea8-4627-8ea4-8f20ace5c0db tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:52.579256 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-63450de9-7a44-4661-b1cc-d4c98b62f0c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:52.585446 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-63450de9-7a44-4661-b1cc-d4c98b62f0c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:52.585902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-63450de9-7a44-4661-b1cc-d4c98b62f0c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:52.586552 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-63450de9-7a44-4661-b1cc-d4c98b62f0c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:52.588174 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-63450de9-7a44-4661-b1cc-d4c98b62f0c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:52.588617 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-63450de9-7a44-4661-b1cc-d4c98b62f0c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:52.589023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-63450de9-7a44-4661-b1cc-d4c98b62f0c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:52.979663 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-608a7182-0ea8-4627-8ea4-8f20ace5c0db tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:52.987876 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-608a7182-0ea8-4627-8ea4-8f20ace5c0db tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.425275 Oct 04 08:55:52.989008 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 229/497] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:52 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:52.994589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-63450de9-7a44-4661-b1cc-d4c98b62f0c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:53.004269 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-63450de9-7a44-4661-b1cc-d4c98b62f0c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:53.005854 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-63450de9-7a44-4661-b1cc-d4c98b62f0c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:53.007296 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-63450de9-7a44-4661-b1cc-d4c98b62f0c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.433496 Oct 04 08:55:53.007979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 269/498] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:52 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:53.099122 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-597383890", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2035428488", "security_groups": [{"name": "tempest-secgroup-smoke-4569898"}], "block_device_mapping_v2": [{"uuid": "84b820f7-cf14-4bd9-aeb3-1608dc7d0384", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a2b42168-a300-492f-b1dd-1ff13847d44a"}]}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:53.219705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.network.neutron [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] validate_networks() for [('a2b42168-a300-492f-b1dd-1ff13847d44a', None, None, None, None, None)] {{(pid=142439) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:55:53.616252 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Flavor limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:55:53.616865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Image limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:55:53.617129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Flavor pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:55:53.617561 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Image pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:55:53.617966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:55:53.627473 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:53.627873 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:53.628364 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:53.629086 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:53.629544 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:53.629983 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:53.647394 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Getting quotas for project 881a40342cb84608b961e6b32dceadb4. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:55:53.651766 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Getting quotas for user d8d329978baf425e954b9965ae0cb652 and project 881a40342cb84608b961e6b32dceadb4. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:55:53.712719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Going to run 1 instances... {{(pid=142439) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:55:53.714901 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84b820f7-cf14-4bd9-aeb3-1608dc7d0384',volume_size=None,volume_type=None)] {{(pid=142439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:55:53.857726 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9bdf06e7-8c0c-42e5-844e-19ea04e6a9c7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.762447 Oct 04 08:55:53.858363 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 230/499] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 08:55:53 2022] POST /compute/v2.1/servers => generated 403 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:55:53.869894 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-fc2bbbe8-28ba-4e1c-99a7-865bae31b8f8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:53.870500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-fc2bbbe8-28ba-4e1c-99a7-865bae31b8f8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:53.939324 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-fc2bbbe8-28ba-4e1c-99a7-865bae31b8f8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:53.954851 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-fc2bbbe8-28ba-4e1c-99a7-865bae31b8f8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1094 microversion: 2.1 time: 0.088463 Oct 04 08:55:53.955453 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 270/500] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:53 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:54.013023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a0475a78-844c-42e3-9440-8f77ec98c9a8 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:54.014031 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a0475a78-844c-42e3-9440-8f77ec98c9a8 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:54.023848 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0475a78-844c-42e3-9440-8f77ec98c9a8 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:54.024533 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0475a78-844c-42e3-9440-8f77ec98c9a8 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:54.025163 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0475a78-844c-42e3-9440-8f77ec98c9a8 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:54.026244 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0475a78-844c-42e3-9440-8f77ec98c9a8 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:54.026786 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0475a78-844c-42e3-9440-8f77ec98c9a8 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:54.027298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0475a78-844c-42e3-9440-8f77ec98c9a8 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:54.033491 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2a3d8e78-ecfc-40dd-b90d-976e40a1eb38 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:54.034106 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2a3d8e78-ecfc-40dd-b90d-976e40a1eb38 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:54.045182 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a3d8e78-ecfc-40dd-b90d-976e40a1eb38 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:54.045671 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a3d8e78-ecfc-40dd-b90d-976e40a1eb38 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:54.046101 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a3d8e78-ecfc-40dd-b90d-976e40a1eb38 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:54.054052 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a3d8e78-ecfc-40dd-b90d-976e40a1eb38 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:54.054610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a3d8e78-ecfc-40dd-b90d-976e40a1eb38 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:54.055048 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a3d8e78-ecfc-40dd-b90d-976e40a1eb38 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:54.252857 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a0475a78-844c-42e3-9440-8f77ec98c9a8 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:54.277798 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2a3d8e78-ecfc-40dd-b90d-976e40a1eb38 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:54.288637 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a0475a78-844c-42e3-9440-8f77ec98c9a8 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.280648 Oct 04 08:55:54.292760 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2a3d8e78-ecfc-40dd-b90d-976e40a1eb38 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:54.298153 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 231/501] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:54 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:54.298658 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2a3d8e78-ecfc-40dd-b90d-976e40a1eb38 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:54.300067 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2a3d8e78-ecfc-40dd-b90d-976e40a1eb38 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.270894 Oct 04 08:55:54.303000 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 271/502] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:54 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:55:54.822382 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a8ffca9d-39f7-4f09-a24a-ecebb86004fc tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:54.822898 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a8ffca9d-39f7-4f09-a24a-ecebb86004fc tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:54.829540 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a8ffca9d-39f7-4f09-a24a-ecebb86004fc tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:54.830021 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a8ffca9d-39f7-4f09-a24a-ecebb86004fc tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:54.830473 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a8ffca9d-39f7-4f09-a24a-ecebb86004fc tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:54.831180 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a8ffca9d-39f7-4f09-a24a-ecebb86004fc tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:54.831631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a8ffca9d-39f7-4f09-a24a-ecebb86004fc tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:54.832080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a8ffca9d-39f7-4f09-a24a-ecebb86004fc tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:54.964981 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-a8ffca9d-39f7-4f09-a24a-ecebb86004fc tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lazy-loading 'services' on Instance uuid 7814cb20-c3e8-4c17-a901-d62f4e7bc4af {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:55:54.982341 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1ccbb7ca-b375-4100-a600-dd6884367a58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:54.983016 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1ccbb7ca-b375-4100-a600-dd6884367a58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:54.990167 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ccbb7ca-b375-4100-a600-dd6884367a58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:54.990729 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ccbb7ca-b375-4100-a600-dd6884367a58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:54.991387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ccbb7ca-b375-4100-a600-dd6884367a58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:54.992184 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ccbb7ca-b375-4100-a600-dd6884367a58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:54.992685 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ccbb7ca-b375-4100-a600-dd6884367a58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:54.993186 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ccbb7ca-b375-4100-a600-dd6884367a58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:55.054838 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1ccbb7ca-b375-4100-a600-dd6884367a58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:55.062182 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1ccbb7ca-b375-4100-a600-dd6884367a58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1192 microversion: 2.1 time: 0.083836 Oct 04 08:55:55.062817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 272/503] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:54 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:55.088858 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a8ffca9d-39f7-4f09-a24a-ecebb86004fc tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af/os-volume_attachments/113183f4-ec1a-4abb-acbb-b59b9a1ed93c" status: 202 len: 0 microversion: 2.1 time: 0.270337 Oct 04 08:55:55.089433 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 232/504] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Oct 4 08:55:54 2022] DELETE /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af/os-volume_attachments/113183f4-ec1a-4abb-acbb-b59b9a1ed93c => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:55:55.321739 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d9bc355b-9404-4e22-b07f-4913d2955c24 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:55.322295 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d9bc355b-9404-4e22-b07f-4913d2955c24 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:55.328979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9bc355b-9404-4e22-b07f-4913d2955c24 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:55.329472 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9bc355b-9404-4e22-b07f-4913d2955c24 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:55.329905 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9bc355b-9404-4e22-b07f-4913d2955c24 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:55.330406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b063ff02-8dca-4f4c-a438-1e989a5a0fdb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:55.330576 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9bc355b-9404-4e22-b07f-4913d2955c24 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:55.331025 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9bc355b-9404-4e22-b07f-4913d2955c24 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:55.331443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9bc355b-9404-4e22-b07f-4913d2955c24 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:55.331650 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b063ff02-8dca-4f4c-a438-1e989a5a0fdb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:55.338097 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b063ff02-8dca-4f4c-a438-1e989a5a0fdb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:55.338708 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b063ff02-8dca-4f4c-a438-1e989a5a0fdb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:55.339204 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b063ff02-8dca-4f4c-a438-1e989a5a0fdb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:55.339947 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b063ff02-8dca-4f4c-a438-1e989a5a0fdb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:55.340419 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b063ff02-8dca-4f4c-a438-1e989a5a0fdb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:55.340830 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b063ff02-8dca-4f4c-a438-1e989a5a0fdb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:55.350838 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=100 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:55.537704 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d9bc355b-9404-4e22-b07f-4913d2955c24 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:55.540947 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b063ff02-8dca-4f4c-a438-1e989a5a0fdb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:55.546619 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d9bc355b-9404-4e22-b07f-4913d2955c24 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.228987 Oct 04 08:55:55.547196 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 273/505] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:55 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:55.549765 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b063ff02-8dca-4f4c-a438-1e989a5a0fdb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:55.551268 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b063ff02-8dca-4f4c-a438-1e989a5a0fdb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:55.552685 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b063ff02-8dca-4f4c-a438-1e989a5a0fdb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.227097 Oct 04 08:55:55.553457 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 233/506] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:55 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:56.089294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-faaeaced-ca32-450e-89fb-e06ee660b8bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:56.090287 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-faaeaced-ca32-450e-89fb-e06ee660b8bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:56.098690 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faaeaced-ca32-450e-89fb-e06ee660b8bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:56.099253 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faaeaced-ca32-450e-89fb-e06ee660b8bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:56.099677 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faaeaced-ca32-450e-89fb-e06ee660b8bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:56.100406 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faaeaced-ca32-450e-89fb-e06ee660b8bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:56.100859 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faaeaced-ca32-450e-89fb-e06ee660b8bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:56.101277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faaeaced-ca32-450e-89fb-e06ee660b8bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:56.171987 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-faaeaced-ca32-450e-89fb-e06ee660b8bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:56.180328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-faaeaced-ca32-450e-89fb-e06ee660b8bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1210 microversion: 2.1 time: 0.097445 Oct 04 08:55:56.185532 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 274/507] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:56 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:56.571111 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4df063c8-75d0-42af-8822-bae404af3b35 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:56.571676 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4df063c8-75d0-42af-8822-bae404af3b35 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:56.579783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4df063c8-75d0-42af-8822-bae404af3b35 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:56.580310 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4df063c8-75d0-42af-8822-bae404af3b35 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:56.580747 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4df063c8-75d0-42af-8822-bae404af3b35 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:56.581518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4df063c8-75d0-42af-8822-bae404af3b35 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:56.582064 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e3b67aa5-c609-4157-aaff-6376a58a759a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:56.582216 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4df063c8-75d0-42af-8822-bae404af3b35 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:56.582597 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4df063c8-75d0-42af-8822-bae404af3b35 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:56.582990 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e3b67aa5-c609-4157-aaff-6376a58a759a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:56.590208 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3b67aa5-c609-4157-aaff-6376a58a759a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:56.590687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3b67aa5-c609-4157-aaff-6376a58a759a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:56.591077 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3b67aa5-c609-4157-aaff-6376a58a759a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:56.591969 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3b67aa5-c609-4157-aaff-6376a58a759a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:56.592557 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3b67aa5-c609-4157-aaff-6376a58a759a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:56.593114 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3b67aa5-c609-4157-aaff-6376a58a759a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:56.864728 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e3b67aa5-c609-4157-aaff-6376a58a759a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:56.871297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4df063c8-75d0-42af-8822-bae404af3b35 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:56.873478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e3b67aa5-c609-4157-aaff-6376a58a759a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:56.874980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e3b67aa5-c609-4157-aaff-6376a58a759a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:56.876325 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e3b67aa5-c609-4157-aaff-6376a58a759a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1744 microversion: 2.20 time: 0.297958 Oct 04 08:55:56.876873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 275/508] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:56 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1744 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:55:56.901057 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4df063c8-75d0-42af-8822-bae404af3b35 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.334381 Oct 04 08:55:56.903969 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 234/509] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:56 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:57.205221 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-41744a6d-722c-4c6e-8136-7513716e3e43 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:57.206211 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-41744a6d-722c-4c6e-8136-7513716e3e43 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:57.213507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41744a6d-722c-4c6e-8136-7513716e3e43 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.214376 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41744a6d-722c-4c6e-8136-7513716e3e43 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.215020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41744a6d-722c-4c6e-8136-7513716e3e43 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:57.216889 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41744a6d-722c-4c6e-8136-7513716e3e43 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.217497 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41744a6d-722c-4c6e-8136-7513716e3e43 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.217959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41744a6d-722c-4c6e-8136-7513716e3e43 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:57.295906 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-50bc16e1-18d0-435c-a102-e2c6c9c0bdf7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:57.296652 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-50bc16e1-18d0-435c-a102-e2c6c9c0bdf7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:57.309654 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-50bc16e1-18d0-435c-a102-e2c6c9c0bdf7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.310463 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-50bc16e1-18d0-435c-a102-e2c6c9c0bdf7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.311536 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-50bc16e1-18d0-435c-a102-e2c6c9c0bdf7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:57.312637 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-50bc16e1-18d0-435c-a102-e2c6c9c0bdf7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.317737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-50bc16e1-18d0-435c-a102-e2c6c9c0bdf7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.318519 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-50bc16e1-18d0-435c-a102-e2c6c9c0bdf7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:57.354793 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-50bc16e1-18d0-435c-a102-e2c6c9c0bdf7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Going to try to terminate instance {{(pid=142439) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:55:57.450920 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-41744a6d-722c-4c6e-8136-7513716e3e43 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:57.455763 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:57.464013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-41744a6d-722c-4c6e-8136-7513716e3e43 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1275 microversion: 2.1 time: 0.263184 Oct 04 08:55:57.464870 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 276/510] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:57 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1275 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:57.479201 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-c194a2e6-517c-47a9-b65e-e8237d6c7332 req-2f25f87a-040c-4de7-9a40-b218ffb70d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3065f8-4fa3-4b25-8362-7c29c79fee76", "name": "network-vif-plugged", "status": "completed", "tag": "3609cbf8-d7b0-457d-a5c9-1e9bf12dc3b3"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:57.513182 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-c194a2e6-517c-47a9-b65e-e8237d6c7332 req-2f25f87a-040c-4de7-9a40-b218ffb70d70 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.514024 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-c194a2e6-517c-47a9-b65e-e8237d6c7332 req-2f25f87a-040c-4de7-9a40-b218ffb70d70 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.514724 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-c194a2e6-517c-47a9-b65e-e8237d6c7332 req-2f25f87a-040c-4de7-9a40-b218ffb70d70 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:57.525259 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-50bc16e1-18d0-435c-a102-e2c6c9c0bdf7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 204 len: 0 microversion: 2.1 time: 0.233363 Oct 04 08:55:57.530598 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 235/511] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 08:55:57 2022] DELETE /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 08:55:57.537304 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-7feff8da-37e7-4c7c-961c-ea2c4c5b0afa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:57.540962 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-c194a2e6-517c-47a9-b65e-e8237d6c7332 req-2f25f87a-040c-4de7-9a40-b218ffb70d70 service nova] Creating event network-vif-plugged:3609cbf8-d7b0-457d-a5c9-1e9bf12dc3b3 for instance 4e3065f8-4fa3-4b25-8362-7c29c79fee76 on hv-cinder-84456 Oct 04 08:55:57.541757 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-7feff8da-37e7-4c7c-961c-ea2c4c5b0afa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:57.550418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7feff8da-37e7-4c7c-961c-ea2c4c5b0afa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.551381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7feff8da-37e7-4c7c-961c-ea2c4c5b0afa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.552277 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7feff8da-37e7-4c7c-961c-ea2c4c5b0afa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:57.553117 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7feff8da-37e7-4c7c-961c-ea2c4c5b0afa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.553848 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7feff8da-37e7-4c7c-961c-ea2c4c5b0afa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.555746 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7feff8da-37e7-4c7c-961c-ea2c4c5b0afa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:57.558309 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-c194a2e6-517c-47a9-b65e-e8237d6c7332 req-2f25f87a-040c-4de7-9a40-b218ffb70d70 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088269 Oct 04 08:55:57.564908 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 277/512] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:57.761814 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7feff8da-37e7-4c7c-961c-ea2c4c5b0afa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:57.771850 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-7feff8da-37e7-4c7c-961c-ea2c4c5b0afa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1513 microversion: 2.1 time: 0.239413 Oct 04 08:55:57.772416 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 236/513] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:57 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1513 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:57.887544 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-65de7075-8169-47a4-97f4-656fec511d1e req-aa30e2b8-f8ad-4ffd-a25d-c6fc5ee6efdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c126bbd8-579f-48ce-88d5-29b61bd75c28", "tag": "aebd8c5b-67fa-48a2-be49-86c0fe14a590"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:57.897769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-65de7075-8169-47a4-97f4-656fec511d1e req-aa30e2b8-f8ad-4ffd-a25d-c6fc5ee6efdf service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.898240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-65de7075-8169-47a4-97f4-656fec511d1e req-aa30e2b8-f8ad-4ffd-a25d-c6fc5ee6efdf service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.898673 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-65de7075-8169-47a4-97f4-656fec511d1e req-aa30e2b8-f8ad-4ffd-a25d-c6fc5ee6efdf service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:57.906384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8d7019d8-c708-4942-a45b-7f7989251680 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:57.907342 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8d7019d8-c708-4942-a45b-7f7989251680 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:57.911016 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-65de7075-8169-47a4-97f4-656fec511d1e req-aa30e2b8-f8ad-4ffd-a25d-c6fc5ee6efdf service nova] Creating event network-changed:aebd8c5b-67fa-48a2-be49-86c0fe14a590 for instance c126bbd8-579f-48ce-88d5-29b61bd75c28 on hv-cinder-84456 Oct 04 08:55:57.914035 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d7019d8-c708-4942-a45b-7f7989251680 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.914808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d7019d8-c708-4942-a45b-7f7989251680 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.915237 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d7019d8-c708-4942-a45b-7f7989251680 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:57.916057 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d7019d8-c708-4942-a45b-7f7989251680 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.916303 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-65de7075-8169-47a4-97f4-656fec511d1e req-aa30e2b8-f8ad-4ffd-a25d-c6fc5ee6efdf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032843 Oct 04 08:55:57.916591 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d7019d8-c708-4942-a45b-7f7989251680 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.917100 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 278/514] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:57.917227 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d7019d8-c708-4942-a45b-7f7989251680 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:57.925550 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-fcf6843a-5e42-4327-b62d-0bd635e37b47 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:57.926244 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-fcf6843a-5e42-4327-b62d-0bd635e37b47 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:57.932723 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fcf6843a-5e42-4327-b62d-0bd635e37b47 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.932860 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fcf6843a-5e42-4327-b62d-0bd635e37b47 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.933231 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fcf6843a-5e42-4327-b62d-0bd635e37b47 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:57.933932 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fcf6843a-5e42-4327-b62d-0bd635e37b47 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.934375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fcf6843a-5e42-4327-b62d-0bd635e37b47 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.934791 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fcf6843a-5e42-4327-b62d-0bd635e37b47 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:58.109695 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8d7019d8-c708-4942-a45b-7f7989251680 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:58.118854 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8d7019d8-c708-4942-a45b-7f7989251680 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:58.120332 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8d7019d8-c708-4942-a45b-7f7989251680 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:58.121498 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8d7019d8-c708-4942-a45b-7f7989251680 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1744 microversion: 2.20 time: 0.219323 Oct 04 08:55:58.121628 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-fcf6843a-5e42-4327-b62d-0bd635e37b47 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:58.122058 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 237/515] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:57 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:58.130725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-fcf6843a-5e42-4327-b62d-0bd635e37b47 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.209306 Oct 04 08:55:58.131420 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 279/516] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:57 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:58.492543 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0af62cd3-16b9-4b48-a934-d3f7d08e3587 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:58.493184 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0af62cd3-16b9-4b48-a934-d3f7d08e3587 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:58.499562 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0af62cd3-16b9-4b48-a934-d3f7d08e3587 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:58.500084 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0af62cd3-16b9-4b48-a934-d3f7d08e3587 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:58.500522 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0af62cd3-16b9-4b48-a934-d3f7d08e3587 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:58.501217 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0af62cd3-16b9-4b48-a934-d3f7d08e3587 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:58.501668 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0af62cd3-16b9-4b48-a934-d3f7d08e3587 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:58.502096 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0af62cd3-16b9-4b48-a934-d3f7d08e3587 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:58.640883 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0af62cd3-16b9-4b48-a934-d3f7d08e3587 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:58.651499 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0af62cd3-16b9-4b48-a934-d3f7d08e3587 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.162996 Oct 04 08:55:58.652422 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 238/517] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:58 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:58.798749 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-259608e3-da17-4a1e-9eb2-fa2758fcb76e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:58.799508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-259608e3-da17-4a1e-9eb2-fa2758fcb76e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:58.807388 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-259608e3-da17-4a1e-9eb2-fa2758fcb76e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:58.808025 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-259608e3-da17-4a1e-9eb2-fa2758fcb76e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:58.808570 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-259608e3-da17-4a1e-9eb2-fa2758fcb76e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:58.809462 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-259608e3-da17-4a1e-9eb2-fa2758fcb76e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:58.810020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-259608e3-da17-4a1e-9eb2-fa2758fcb76e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:58.810573 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-259608e3-da17-4a1e-9eb2-fa2758fcb76e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:58.951636 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-259608e3-da17-4a1e-9eb2-fa2758fcb76e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:58.959566 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-259608e3-da17-4a1e-9eb2-fa2758fcb76e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1513 microversion: 2.1 time: 0.167393 Oct 04 08:55:58.960158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 280/518] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:58 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:59.146814 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fae1b8ec-3bb0-4da9-b673-eee9031627d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:59.148422 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-fae1b8ec-3bb0-4da9-b673-eee9031627d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:59.152909 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-795a25bb-4a9a-4e3d-aada-c15a4fe534af tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:59.153533 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-795a25bb-4a9a-4e3d-aada-c15a4fe534af tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:59.154796 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fae1b8ec-3bb0-4da9-b673-eee9031627d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:59.155352 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fae1b8ec-3bb0-4da9-b673-eee9031627d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:59.155854 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fae1b8ec-3bb0-4da9-b673-eee9031627d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:59.156677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fae1b8ec-3bb0-4da9-b673-eee9031627d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:59.157243 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fae1b8ec-3bb0-4da9-b673-eee9031627d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:59.157771 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fae1b8ec-3bb0-4da9-b673-eee9031627d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:59.159551 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-795a25bb-4a9a-4e3d-aada-c15a4fe534af tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:59.160048 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-795a25bb-4a9a-4e3d-aada-c15a4fe534af tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:59.160647 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-795a25bb-4a9a-4e3d-aada-c15a4fe534af tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:59.161363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-795a25bb-4a9a-4e3d-aada-c15a4fe534af tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:59.163203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-795a25bb-4a9a-4e3d-aada-c15a4fe534af tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:59.163652 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-795a25bb-4a9a-4e3d-aada-c15a4fe534af tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:59.482457 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-fae1b8ec-3bb0-4da9-b673-eee9031627d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:59.492308 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-fae1b8ec-3bb0-4da9-b673-eee9031627d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:59.493776 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-fae1b8ec-3bb0-4da9-b673-eee9031627d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:59.494939 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fae1b8ec-3bb0-4da9-b673-eee9031627d4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1744 microversion: 2.20 time: 0.352095 Oct 04 08:55:59.495731 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 239/519] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:59 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1744 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:59.524550 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-795a25bb-4a9a-4e3d-aada-c15a4fe534af tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:59.532532 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-795a25bb-4a9a-4e3d-aada-c15a4fe534af tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.383686 Oct 04 08:55:59.533328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 281/520] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:59 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:59.578298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-72e40411-7255-4b92-b4ba-1143fef5be86 req-10124b66-7b96-42bc-8447-985af8e173d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4454abc-67a9-470b-bdce-5a69bc51bbed", "name": "network-vif-plugged", "status": "completed", "tag": "a52bd48f-906c-4b87-b387-01e1bfaa69c2"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:59.593199 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-72e40411-7255-4b92-b4ba-1143fef5be86 req-10124b66-7b96-42bc-8447-985af8e173d3 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:59.593891 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-72e40411-7255-4b92-b4ba-1143fef5be86 req-10124b66-7b96-42bc-8447-985af8e173d3 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:59.594511 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-72e40411-7255-4b92-b4ba-1143fef5be86 req-10124b66-7b96-42bc-8447-985af8e173d3 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:59.605789 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-72e40411-7255-4b92-b4ba-1143fef5be86 req-10124b66-7b96-42bc-8447-985af8e173d3 service nova] Creating event network-vif-plugged:a52bd48f-906c-4b87-b387-01e1bfaa69c2 for instance f4454abc-67a9-470b-bdce-5a69bc51bbed on hv-cinder-84456 Oct 04 08:55:59.610752 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-72e40411-7255-4b92-b4ba-1143fef5be86 req-10124b66-7b96-42bc-8447-985af8e173d3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036108 Oct 04 08:55:59.611306 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 240/521] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:59.678139 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b5e27ed9-25cf-4e2c-9b12-9b8d74894ce1 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:59.679258 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b5e27ed9-25cf-4e2c-9b12-9b8d74894ce1 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:59.686691 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b5e27ed9-25cf-4e2c-9b12-9b8d74894ce1 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:59.687168 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b5e27ed9-25cf-4e2c-9b12-9b8d74894ce1 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:59.687594 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b5e27ed9-25cf-4e2c-9b12-9b8d74894ce1 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:59.688439 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b5e27ed9-25cf-4e2c-9b12-9b8d74894ce1 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:59.689228 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b5e27ed9-25cf-4e2c-9b12-9b8d74894ce1 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:59.689644 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b5e27ed9-25cf-4e2c-9b12-9b8d74894ce1 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:59.830598 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b5e27ed9-25cf-4e2c-9b12-9b8d74894ce1 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:59.838578 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b5e27ed9-25cf-4e2c-9b12-9b8d74894ce1 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.167680 Oct 04 08:55:59.839166 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 282/522] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:59 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:59.984713 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8f336390-06c6-46f1-a9f2-47a683527f6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:59.985465 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8f336390-06c6-46f1-a9f2-47a683527f6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:59.992708 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8f336390-06c6-46f1-a9f2-47a683527f6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:59.993173 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8f336390-06c6-46f1-a9f2-47a683527f6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:59.993628 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8f336390-06c6-46f1-a9f2-47a683527f6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:59.994326 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8f336390-06c6-46f1-a9f2-47a683527f6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:59.994779 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8f336390-06c6-46f1-a9f2-47a683527f6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:59.995207 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8f336390-06c6-46f1-a9f2-47a683527f6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:00.140649 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8f336390-06c6-46f1-a9f2-47a683527f6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:00.149748 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8f336390-06c6-46f1-a9f2-47a683527f6b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1513 microversion: 2.1 time: 0.169281 Oct 04 08:56:00.150337 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 241/523] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:59 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:00.524077 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b9a3323a-e7e1-437f-8a92-3459fff2667f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:00.524927 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b9a3323a-e7e1-437f-8a92-3459fff2667f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:00.534094 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9a3323a-e7e1-437f-8a92-3459fff2667f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:00.534576 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9a3323a-e7e1-437f-8a92-3459fff2667f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:00.534998 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9a3323a-e7e1-437f-8a92-3459fff2667f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:00.535684 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9a3323a-e7e1-437f-8a92-3459fff2667f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:00.536166 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9a3323a-e7e1-437f-8a92-3459fff2667f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:00.536584 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9a3323a-e7e1-437f-8a92-3459fff2667f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:00.554656 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f3f632b9-b9ba-4831-b126-0df4b192d8c4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:00.555314 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f3f632b9-b9ba-4831-b126-0df4b192d8c4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:00.557374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:00.562687 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f3f632b9-b9ba-4831-b126-0df4b192d8c4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:00.563177 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f3f632b9-b9ba-4831-b126-0df4b192d8c4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:00.563603 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f3f632b9-b9ba-4831-b126-0df4b192d8c4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:00.564320 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f3f632b9-b9ba-4831-b126-0df4b192d8c4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:00.564908 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f3f632b9-b9ba-4831-b126-0df4b192d8c4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:00.565332 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f3f632b9-b9ba-4831-b126-0df4b192d8c4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:01.087198 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b9a3323a-e7e1-437f-8a92-3459fff2667f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:01.090133 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f3f632b9-b9ba-4831-b126-0df4b192d8c4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:01.095334 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b9a3323a-e7e1-437f-8a92-3459fff2667f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:01.096859 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b9a3323a-e7e1-437f-8a92-3459fff2667f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:01.098009 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b9a3323a-e7e1-437f-8a92-3459fff2667f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1744 microversion: 2.20 time: 0.580341 Oct 04 08:56:01.098192 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f3f632b9-b9ba-4831-b126-0df4b192d8c4 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.547364 Oct 04 08:56:01.098784 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 283/524] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:00 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1744 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:01.101153 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 242/525] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:00 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:01.104070 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-8fc74411-8ef6-4f6f-9908-5dc33685a177 req-8f19c519-a30a-44f8-9096-f59d4443b6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7814cb20-c3e8-4c17-a901-d62f4e7bc4af", "name": "network-vif-deleted", "tag": "9af692a1-b931-4d82-9e18-3ab10e16c20a"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:01.104750 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a90ac77c-dc9f-4978-a7e4-68d70188a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:01.105354 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a90ac77c-dc9f-4978-a7e4-68d70188a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:01.111872 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a90ac77c-dc9f-4978-a7e4-68d70188a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:01.112382 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a90ac77c-dc9f-4978-a7e4-68d70188a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:01.112814 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a90ac77c-dc9f-4978-a7e4-68d70188a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:01.113863 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a90ac77c-dc9f-4978-a7e4-68d70188a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:01.114301 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a90ac77c-dc9f-4978-a7e4-68d70188a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:01.114719 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a90ac77c-dc9f-4978-a7e4-68d70188a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:01.115490 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-8fc74411-8ef6-4f6f-9908-5dc33685a177 req-8f19c519-a30a-44f8-9096-f59d4443b6fb service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:01.116009 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-8fc74411-8ef6-4f6f-9908-5dc33685a177 req-8f19c519-a30a-44f8-9096-f59d4443b6fb service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:01.116429 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-8fc74411-8ef6-4f6f-9908-5dc33685a177 req-8f19c519-a30a-44f8-9096-f59d4443b6fb service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:01.127752 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-8fc74411-8ef6-4f6f-9908-5dc33685a177 req-8f19c519-a30a-44f8-9096-f59d4443b6fb service nova] Creating event network-vif-deleted:9af692a1-b931-4d82-9e18-3ab10e16c20a for instance 7814cb20-c3e8-4c17-a901-d62f4e7bc4af on hv-cinder-84456 Oct 04 08:56:01.132724 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-8fc74411-8ef6-4f6f-9908-5dc33685a177 req-8f19c519-a30a-44f8-9096-f59d4443b6fb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032090 Oct 04 08:56:01.133322 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 243/526] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:01.172532 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-32698691-a34e-4ad1-8be9-0cf3dec7ee53 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:01.173265 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-32698691-a34e-4ad1-8be9-0cf3dec7ee53 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:01.179493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32698691-a34e-4ad1-8be9-0cf3dec7ee53 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:01.180046 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32698691-a34e-4ad1-8be9-0cf3dec7ee53 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:01.180488 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32698691-a34e-4ad1-8be9-0cf3dec7ee53 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:01.181251 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32698691-a34e-4ad1-8be9-0cf3dec7ee53 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:01.181620 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32698691-a34e-4ad1-8be9-0cf3dec7ee53 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:01.182114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32698691-a34e-4ad1-8be9-0cf3dec7ee53 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:01.246258 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-32698691-a34e-4ad1-8be9-0cf3dec7ee53 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:01.254178 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-32698691-a34e-4ad1-8be9-0cf3dec7ee53 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1471 microversion: 2.1 time: 0.085948 Oct 04 08:56:01.254759 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 244/527] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:01 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1471 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:01.269853 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-a90ac77c-dc9f-4978-a7e4-68d70188a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:01.277701 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a90ac77c-dc9f-4978-a7e4-68d70188a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.178193 Oct 04 08:56:01.278301 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 284/528] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:01 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:02.121687 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-046eee36-00c9-48fe-812e-cddaa645600e tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:02.122206 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-046eee36-00c9-48fe-812e-cddaa645600e tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:02.123795 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-866712d2-b40d-4d29-b222-35149e593e0e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:02.124427 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-866712d2-b40d-4d29-b222-35149e593e0e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:02.130542 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-046eee36-00c9-48fe-812e-cddaa645600e tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:02.131017 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-046eee36-00c9-48fe-812e-cddaa645600e tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:02.131445 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-046eee36-00c9-48fe-812e-cddaa645600e tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:02.131604 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-866712d2-b40d-4d29-b222-35149e593e0e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:02.132232 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-866712d2-b40d-4d29-b222-35149e593e0e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:02.132923 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-866712d2-b40d-4d29-b222-35149e593e0e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:02.133959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-866712d2-b40d-4d29-b222-35149e593e0e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:02.134821 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-866712d2-b40d-4d29-b222-35149e593e0e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:02.135510 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-866712d2-b40d-4d29-b222-35149e593e0e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:02.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-046eee36-00c9-48fe-812e-cddaa645600e tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:02.144975 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-046eee36-00c9-48fe-812e-cddaa645600e tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:02.145570 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-046eee36-00c9-48fe-812e-cddaa645600e tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:02.338264 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-866712d2-b40d-4d29-b222-35149e593e0e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:02.341142 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-046eee36-00c9-48fe-812e-cddaa645600e tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:02.347495 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-866712d2-b40d-4d29-b222-35149e593e0e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:02.348950 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-866712d2-b40d-4d29-b222-35149e593e0e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:02.349263 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-046eee36-00c9-48fe-812e-cddaa645600e tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1313 microversion: 2.1 time: 0.231486 Oct 04 08:56:02.349874 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 245/529] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:02 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:02.350087 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-866712d2-b40d-4d29-b222-35149e593e0e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1744 microversion: 2.20 time: 0.230194 Oct 04 08:56:02.363925 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 285/530] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:02 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1744 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:02.364103 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-14724638-c372-4128-8a39-8510a42e3f6d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:02.364103 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-14724638-c372-4128-8a39-8510a42e3f6d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:02.364282 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-62ed473c-b03c-4c0b-8dcc-b9eaafd9194b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:02.364282 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-62ed473c-b03c-4c0b-8dcc-b9eaafd9194b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:02.364282 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62ed473c-b03c-4c0b-8dcc-b9eaafd9194b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:02.364282 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62ed473c-b03c-4c0b-8dcc-b9eaafd9194b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:02.364568 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62ed473c-b03c-4c0b-8dcc-b9eaafd9194b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:02.364642 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-14724638-c372-4128-8a39-8510a42e3f6d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:02.364642 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-14724638-c372-4128-8a39-8510a42e3f6d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:02.364798 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62ed473c-b03c-4c0b-8dcc-b9eaafd9194b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:02.364875 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-14724638-c372-4128-8a39-8510a42e3f6d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:02.364964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62ed473c-b03c-4c0b-8dcc-b9eaafd9194b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:02.364964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62ed473c-b03c-4c0b-8dcc-b9eaafd9194b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:02.365116 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-14724638-c372-4128-8a39-8510a42e3f6d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:02.365191 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-14724638-c372-4128-8a39-8510a42e3f6d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:02.365681 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-14724638-c372-4128-8a39-8510a42e3f6d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:02.399101 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-14724638-c372-4128-8a39-8510a42e3f6d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:02.399486 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-14724638-c372-4128-8a39-8510a42e3f6d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:02.399923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-14724638-c372-4128-8a39-8510a42e3f6d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:02.400364 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-14724638-c372-4128-8a39-8510a42e3f6d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lazy-loading 'fault' on Instance uuid 7814cb20-c3e8-4c17-a901-d62f4e7bc4af {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:02.462332 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-14724638-c372-4128-8a39-8510a42e3f6d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:02.470697 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-14724638-c372-4128-8a39-8510a42e3f6d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1308 microversion: 2.1 time: 0.119769 Oct 04 08:56:02.471505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 246/531] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:02 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:02.524294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-62ed473c-b03c-4c0b-8dcc-b9eaafd9194b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:02.535393 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-62ed473c-b03c-4c0b-8dcc-b9eaafd9194b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.183762 Oct 04 08:56:02.535957 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 286/532] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:02 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:03.376288 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-3df8334b-f732-4264-a973-af35ba523430 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:03.377424 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-3df8334b-f732-4264-a973-af35ba523430 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:03.380529 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-321295f0-d760-40df-a4a8-dafc010271a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:03.381247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-321295f0-d760-40df-a4a8-dafc010271a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:03.384528 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3df8334b-f732-4264-a973-af35ba523430 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:03.385017 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3df8334b-f732-4264-a973-af35ba523430 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:03.385445 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3df8334b-f732-4264-a973-af35ba523430 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:03.386163 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3df8334b-f732-4264-a973-af35ba523430 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:03.386657 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3df8334b-f732-4264-a973-af35ba523430 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:03.387081 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3df8334b-f732-4264-a973-af35ba523430 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:03.387763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-321295f0-d760-40df-a4a8-dafc010271a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:03.388272 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-321295f0-d760-40df-a4a8-dafc010271a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:03.388697 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-321295f0-d760-40df-a4a8-dafc010271a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:03.389360 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-321295f0-d760-40df-a4a8-dafc010271a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:03.389872 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-321295f0-d760-40df-a4a8-dafc010271a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:03.390288 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-321295f0-d760-40df-a4a8-dafc010271a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:03.581779 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-3df8334b-f732-4264-a973-af35ba523430 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:03.584874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-321295f0-d760-40df-a4a8-dafc010271a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:03.589752 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-3df8334b-f732-4264-a973-af35ba523430 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1497 microversion: 2.1 time: 0.220167 Oct 04 08:56:03.595260 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 247/533] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:03 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1497 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:03.595410 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-321295f0-d760-40df-a4a8-dafc010271a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:03.595410 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-321295f0-d760-40df-a4a8-dafc010271a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:03.595600 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-bc111602-1c83-4b20-bbd5-a91ea1dd5049 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:03.595600 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-bc111602-1c83-4b20-bbd5-a91ea1dd5049 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:03.595876 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-321295f0-d760-40df-a4a8-dafc010271a6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1744 microversion: 2.20 time: 0.220070 Oct 04 08:56:03.596594 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 287/534] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:03 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:03.605412 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bc111602-1c83-4b20-bbd5-a91ea1dd5049 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:03.605412 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bc111602-1c83-4b20-bbd5-a91ea1dd5049 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:03.605412 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bc111602-1c83-4b20-bbd5-a91ea1dd5049 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:03.605412 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bc111602-1c83-4b20-bbd5-a91ea1dd5049 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:03.605743 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bc111602-1c83-4b20-bbd5-a91ea1dd5049 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:03.605743 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bc111602-1c83-4b20-bbd5-a91ea1dd5049 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:03.612887 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-eb69bd8f-602b-4b0b-8ff6-ee72ea560ad4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:03.614008 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-eb69bd8f-602b-4b0b-8ff6-ee72ea560ad4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:03.620635 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-eb69bd8f-602b-4b0b-8ff6-ee72ea560ad4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:03.622653 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-eb69bd8f-602b-4b0b-8ff6-ee72ea560ad4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:03.623200 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-eb69bd8f-602b-4b0b-8ff6-ee72ea560ad4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:03.624040 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-eb69bd8f-602b-4b0b-8ff6-ee72ea560ad4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:03.624618 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-eb69bd8f-602b-4b0b-8ff6-ee72ea560ad4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:03.625134 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-eb69bd8f-602b-4b0b-8ff6-ee72ea560ad4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:03.636588 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:03.645885 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bc111602-1c83-4b20-bbd5-a91ea1dd5049 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:03.646347 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bc111602-1c83-4b20-bbd5-a91ea1dd5049 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:03.647627 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bc111602-1c83-4b20-bbd5-a91ea1dd5049 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:03.648171 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-bc111602-1c83-4b20-bbd5-a91ea1dd5049 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lazy-loading 'fault' on Instance uuid 7814cb20-c3e8-4c17-a901-d62f4e7bc4af {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:03.658982 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=6 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:03.718936 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-bc111602-1c83-4b20-bbd5-a91ea1dd5049 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:03.728448 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-bc111602-1c83-4b20-bbd5-a91ea1dd5049 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 200 len: 1308 microversion: 2.1 time: 0.136877 Oct 04 08:56:03.731090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 248/535] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:03 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 1308 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:03.791076 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-eb69bd8f-602b-4b0b-8ff6-ee72ea560ad4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:03.799071 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-eb69bd8f-602b-4b0b-8ff6-ee72ea560ad4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.191710 Oct 04 08:56:03.799618 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 288/536] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:03 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:04.221208 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a584cd0d-139d-472a-9b8a-7fe16af9c7e9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:04.221724 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a584cd0d-139d-472a-9b8a-7fe16af9c7e9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:04.228040 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a584cd0d-139d-472a-9b8a-7fe16af9c7e9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:04.228510 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a584cd0d-139d-472a-9b8a-7fe16af9c7e9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:04.228937 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a584cd0d-139d-472a-9b8a-7fe16af9c7e9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:04.229618 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a584cd0d-139d-472a-9b8a-7fe16af9c7e9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:04.230046 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a584cd0d-139d-472a-9b8a-7fe16af9c7e9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:04.230461 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a584cd0d-139d-472a-9b8a-7fe16af9c7e9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:04.256406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a584cd0d-139d-472a-9b8a-7fe16af9c7e9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Going to try to terminate instance {{(pid=142439) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:56:04.339725 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a584cd0d-139d-472a-9b8a-7fe16af9c7e9 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 204 len: 0 microversion: 2.1 time: 0.121763 Oct 04 08:56:04.340568 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 249/537] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 08:56:04 2022] DELETE /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:56:04.350340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-42d272f0-1b03-4dbf-8615-654445e6d8cf tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:04.350921 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-42d272f0-1b03-4dbf-8615-654445e6d8cf tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:04.352900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:04.358325 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-42d272f0-1b03-4dbf-8615-654445e6d8cf tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:04.358813 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-42d272f0-1b03-4dbf-8615-654445e6d8cf tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:04.359423 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-42d272f0-1b03-4dbf-8615-654445e6d8cf tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:04.360203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-42d272f0-1b03-4dbf-8615-654445e6d8cf tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:04.360590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-42d272f0-1b03-4dbf-8615-654445e6d8cf tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:04.361065 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-42d272f0-1b03-4dbf-8615-654445e6d8cf tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:04.495281 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-42d272f0-1b03-4dbf-8615-654445e6d8cf tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:04.506669 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-42d272f0-1b03-4dbf-8615-654445e6d8cf tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1503 microversion: 2.1 time: 0.159896 Oct 04 08:56:04.507438 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 289/538] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:04 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:04.623655 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5bcf6e46-3f0c-46e2-bf23-0d6f064d29ac tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:04.625114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5bcf6e46-3f0c-46e2-bf23-0d6f064d29ac tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:04.632517 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5bcf6e46-3f0c-46e2-bf23-0d6f064d29ac tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:04.633028 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5bcf6e46-3f0c-46e2-bf23-0d6f064d29ac tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:04.633465 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5bcf6e46-3f0c-46e2-bf23-0d6f064d29ac tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:04.634170 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5bcf6e46-3f0c-46e2-bf23-0d6f064d29ac tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:04.634605 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5bcf6e46-3f0c-46e2-bf23-0d6f064d29ac tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:04.635200 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5bcf6e46-3f0c-46e2-bf23-0d6f064d29ac tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:04.757458 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e3cb01ed-9c31-40ac-8851-f6eb6fa6cca6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:04.758046 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e3cb01ed-9c31-40ac-8851-f6eb6fa6cca6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: 7814cb20-c3e8-4c17-a901-d62f4e7bc4af] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:04.764368 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3cb01ed-9c31-40ac-8851-f6eb6fa6cca6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:04.764851 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3cb01ed-9c31-40ac-8851-f6eb6fa6cca6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:04.765284 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3cb01ed-9c31-40ac-8851-f6eb6fa6cca6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:04.765981 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3cb01ed-9c31-40ac-8851-f6eb6fa6cca6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:04.766426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3cb01ed-9c31-40ac-8851-f6eb6fa6cca6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:04.766848 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3cb01ed-9c31-40ac-8851-f6eb6fa6cca6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:04.772126 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5bcf6e46-3f0c-46e2-bf23-0d6f064d29ac tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:04.780823 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5bcf6e46-3f0c-46e2-bf23-0d6f064d29ac tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:04.781163 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-e3cb01ed-9c31-40ac-8851-f6eb6fa6cca6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] HTTP exception thrown: Instance 7814cb20-c3e8-4c17-a901-d62f4e7bc4af could not be found. Oct 04 08:56:04.782432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5bcf6e46-3f0c-46e2-bf23-0d6f064d29ac tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e3cb01ed-9c31-40ac-8851-f6eb6fa6cca6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Request method failure captured: Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af HTTP/1.1 Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_StDtfzIhrgKzYaDab3kNj8G11HByOK-nwvTWdEX0NVtjVV-s0r29JeuDMbG_lXiaZ4USrPmYcyJqVBQ48O1bTr1GxckRSvUTIh45_Snu7BG-vfcq5b7b1xtU2DHxk_YAX-LGzTpqkx0DFdN1pOJdtZg8bA3D7w-A1M9jtoxJa7_ko Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 67b474ba7f7a465caa2ed14f891ac951 Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1449085317 Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 08:56:04.782873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 08:56:04.784582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_67b474ba7f7a465caa2ed14f891ac951", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/67b474ba7f7a465caa2ed14f891ac951"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/67b474ba7f7a465caa2ed14f891ac951"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/67b474ba7f7a465caa2ed14f891ac951"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:56:04.784582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-VolumesSnapshotTestJSON-1449085317 Oct 04 08:56:04.784582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 67b474ba7f7a465caa2ed14f891ac951 Oct 04 08:56:04.784582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1449085317 Oct 04 08:56:04.784582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-VolumesSnapshotTestJSON-1449085317-project Oct 04 08:56:04.784582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 08:56:04.784582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 08:56:04.784582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 1e44ee032c5346ec9260740bcb700007 Oct 04 08:56:04.784582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-VolumesSnapshotTestJSON-1449085317-project Oct 04 08:56:04.784582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 08:56:04.784582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance 7814cb20-c3e8-4c17-a901-d62f4e7bc4af could not be found. Oct 04 08:56:04.784582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': '7814cb20-c3e8-4c17-a901-d62f4e7bc4af'} Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7814cb20-c3e8-4c17-a901-d62f4e7bc4af could not be found. Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:04.785475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7814cb20-c3e8-4c17-a901-d62f4e7bc4af could not be found. Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7814cb20-c3e8-4c17-a901-d62f4e7bc4af could not be found. Oct 04 08:56:04.786676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:56:04.788222 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e3cb01ed-9c31-40ac-8851-f6eb6fa6cca6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Returning 404 to user: Instance 7814cb20-c3e8-4c17-a901-d62f4e7bc4af could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:04.788222 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e3cb01ed-9c31-40ac-8851-f6eb6fa6cca6 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af" status: 404 len: 111 microversion: 2.1 time: 0.030869 Oct 04 08:56:04.788375 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5bcf6e46-3f0c-46e2-bf23-0d6f064d29ac tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.165547 Oct 04 08:56:04.788458 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 290/539] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:04 2022] GET /compute/v2.1/servers/7814cb20-c3e8-4c17-a901-d62f4e7bc4af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:04.788531 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 250/540] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:04 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:04.824776 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9b043358-b1aa-4dce-8790-f58e7c4898c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:04.825466 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9b043358-b1aa-4dce-8790-f58e7c4898c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:04.831547 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9b043358-b1aa-4dce-8790-f58e7c4898c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:04.832073 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9b043358-b1aa-4dce-8790-f58e7c4898c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:04.832490 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9b043358-b1aa-4dce-8790-f58e7c4898c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:04.833177 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9b043358-b1aa-4dce-8790-f58e7c4898c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:04.833623 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9b043358-b1aa-4dce-8790-f58e7c4898c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:04.834045 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9b043358-b1aa-4dce-8790-f58e7c4898c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:04.971814 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9b043358-b1aa-4dce-8790-f58e7c4898c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:04.980027 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-9b043358-b1aa-4dce-8790-f58e7c4898c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.159509 Oct 04 08:56:04.980615 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 291/541] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:04 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:05.536276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b1279bdf-c96e-4390-aca1-eea8526bfa9c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:05.536886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b1279bdf-c96e-4390-aca1-eea8526bfa9c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:05.543392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b1279bdf-c96e-4390-aca1-eea8526bfa9c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:05.543873 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b1279bdf-c96e-4390-aca1-eea8526bfa9c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:05.544323 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b1279bdf-c96e-4390-aca1-eea8526bfa9c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:05.545005 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b1279bdf-c96e-4390-aca1-eea8526bfa9c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:05.545457 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b1279bdf-c96e-4390-aca1-eea8526bfa9c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:05.545873 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b1279bdf-c96e-4390-aca1-eea8526bfa9c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:05.560485 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:05.688110 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b1279bdf-c96e-4390-aca1-eea8526bfa9c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:05.696254 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b1279bdf-c96e-4390-aca1-eea8526bfa9c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1503 microversion: 2.1 time: 0.165050 Oct 04 08:56:05.696822 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 251/542] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:05 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:05.813902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-afdd5927-1c16-4a52-b008-9160845d3009 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:05.814925 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-afdd5927-1c16-4a52-b008-9160845d3009 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:05.822347 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-afdd5927-1c16-4a52-b008-9160845d3009 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:05.822918 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-afdd5927-1c16-4a52-b008-9160845d3009 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:05.823426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-afdd5927-1c16-4a52-b008-9160845d3009 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:05.824285 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-afdd5927-1c16-4a52-b008-9160845d3009 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:05.824815 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-afdd5927-1c16-4a52-b008-9160845d3009 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:05.825313 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-afdd5927-1c16-4a52-b008-9160845d3009 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:05.829988 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=100 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:05.969864 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-afdd5927-1c16-4a52-b008-9160845d3009 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:05.979335 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-afdd5927-1c16-4a52-b008-9160845d3009 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:05.980801 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-afdd5927-1c16-4a52-b008-9160845d3009 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:05.982029 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-afdd5927-1c16-4a52-b008-9160845d3009 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.174795 Oct 04 08:56:05.982547 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 292/543] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:05 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:06.002597 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4b58e9c8-508c-4c2a-abe2-4abcb825a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:06.003221 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4b58e9c8-508c-4c2a-abe2-4abcb825a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:06.009379 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b58e9c8-508c-4c2a-abe2-4abcb825a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:06.009863 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b58e9c8-508c-4c2a-abe2-4abcb825a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:06.010297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b58e9c8-508c-4c2a-abe2-4abcb825a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:06.010988 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b58e9c8-508c-4c2a-abe2-4abcb825a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:06.011433 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b58e9c8-508c-4c2a-abe2-4abcb825a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:06.011853 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b58e9c8-508c-4c2a-abe2-4abcb825a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:06.147279 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4b58e9c8-508c-4c2a-abe2-4abcb825a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:06.159842 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4b58e9c8-508c-4c2a-abe2-4abcb825a7ea tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.160775 Oct 04 08:56:06.160881 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 252/544] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:05 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:06.724461 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-abce57ce-bfcd-43c8-a5ac-04dcbd9d7567 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:06.725475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-abce57ce-bfcd-43c8-a5ac-04dcbd9d7567 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:06.735616 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-abce57ce-bfcd-43c8-a5ac-04dcbd9d7567 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:06.736637 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-abce57ce-bfcd-43c8-a5ac-04dcbd9d7567 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:06.737060 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-abce57ce-bfcd-43c8-a5ac-04dcbd9d7567 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:06.737749 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-abce57ce-bfcd-43c8-a5ac-04dcbd9d7567 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:06.738196 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-abce57ce-bfcd-43c8-a5ac-04dcbd9d7567 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:06.738967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-abce57ce-bfcd-43c8-a5ac-04dcbd9d7567 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:06.880826 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-abce57ce-bfcd-43c8-a5ac-04dcbd9d7567 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:06.889174 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-abce57ce-bfcd-43c8-a5ac-04dcbd9d7567 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1503 microversion: 2.1 time: 0.172121 Oct 04 08:56:06.889739 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 293/545] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:06 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:07.012261 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0105b112-4fa0-4995-8f58-a191d58dab7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:07.013165 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0105b112-4fa0-4995-8f58-a191d58dab7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:07.024314 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0105b112-4fa0-4995-8f58-a191d58dab7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.025127 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0105b112-4fa0-4995-8f58-a191d58dab7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.025861 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0105b112-4fa0-4995-8f58-a191d58dab7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:07.027012 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0105b112-4fa0-4995-8f58-a191d58dab7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.027768 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0105b112-4fa0-4995-8f58-a191d58dab7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.028638 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0105b112-4fa0-4995-8f58-a191d58dab7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:07.162202 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0105b112-4fa0-4995-8f58-a191d58dab7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:07.170757 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0105b112-4fa0-4995-8f58-a191d58dab7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:07.172266 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0105b112-4fa0-4995-8f58-a191d58dab7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:07.173425 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0105b112-4fa0-4995-8f58-a191d58dab7f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.168085 Oct 04 08:56:07.173953 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 253/546] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:07 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:07.188588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-dcf55d16-d360-458f-acf8-e6c083580a2b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:07.189323 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-dcf55d16-d360-458f-acf8-e6c083580a2b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:07.195863 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dcf55d16-d360-458f-acf8-e6c083580a2b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.196386 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dcf55d16-d360-458f-acf8-e6c083580a2b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.196823 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dcf55d16-d360-458f-acf8-e6c083580a2b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:07.197554 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dcf55d16-d360-458f-acf8-e6c083580a2b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.198003 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dcf55d16-d360-458f-acf8-e6c083580a2b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.198425 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dcf55d16-d360-458f-acf8-e6c083580a2b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:07.335698 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-dcf55d16-d360-458f-acf8-e6c083580a2b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:07.343572 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-dcf55d16-d360-458f-acf8-e6c083580a2b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.158954 Oct 04 08:56:07.344172 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 294/547] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:07 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:07.917134 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c8e034cf-2acb-4890-a986-5f60f1aa15c0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:07.918128 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c8e034cf-2acb-4890-a986-5f60f1aa15c0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:07.928630 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c8e034cf-2acb-4890-a986-5f60f1aa15c0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.929466 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c8e034cf-2acb-4890-a986-5f60f1aa15c0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.930161 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c8e034cf-2acb-4890-a986-5f60f1aa15c0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:07.931304 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c8e034cf-2acb-4890-a986-5f60f1aa15c0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.932299 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c8e034cf-2acb-4890-a986-5f60f1aa15c0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.933125 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c8e034cf-2acb-4890-a986-5f60f1aa15c0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:08.073238 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c8e034cf-2acb-4890-a986-5f60f1aa15c0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:08.082054 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c8e034cf-2acb-4890-a986-5f60f1aa15c0 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1503 microversion: 2.1 time: 0.171588 Oct 04 08:56:08.082629 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 254/548] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:07 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:08.199726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-bbdc81f4-8f24-4133-a699-6fdcc7ae7ef4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:08.200364 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-bbdc81f4-8f24-4133-a699-6fdcc7ae7ef4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:08.207801 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bbdc81f4-8f24-4133-a699-6fdcc7ae7ef4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:08.208335 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bbdc81f4-8f24-4133-a699-6fdcc7ae7ef4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:08.208741 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bbdc81f4-8f24-4133-a699-6fdcc7ae7ef4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:08.209423 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bbdc81f4-8f24-4133-a699-6fdcc7ae7ef4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:08.209866 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bbdc81f4-8f24-4133-a699-6fdcc7ae7ef4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:08.210283 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bbdc81f4-8f24-4133-a699-6fdcc7ae7ef4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:08.355233 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-bbdc81f4-8f24-4133-a699-6fdcc7ae7ef4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:08.366549 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-bbdc81f4-8f24-4133-a699-6fdcc7ae7ef4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:08.366906 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-defb111a-3379-458b-ad41-e67a8f67c018 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:08.367615 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-defb111a-3379-458b-ad41-e67a8f67c018 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:08.368025 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-bbdc81f4-8f24-4133-a699-6fdcc7ae7ef4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:08.369191 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-bbdc81f4-8f24-4133-a699-6fdcc7ae7ef4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.173950 Oct 04 08:56:08.369749 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 295/549] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:08 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:08.374039 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-defb111a-3379-458b-ad41-e67a8f67c018 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:08.374527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-defb111a-3379-458b-ad41-e67a8f67c018 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:08.374960 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-defb111a-3379-458b-ad41-e67a8f67c018 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:08.375656 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-defb111a-3379-458b-ad41-e67a8f67c018 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:08.376145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-defb111a-3379-458b-ad41-e67a8f67c018 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:08.376567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-defb111a-3379-458b-ad41-e67a8f67c018 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:08.526767 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-defb111a-3379-458b-ad41-e67a8f67c018 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:08.535077 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-defb111a-3379-458b-ad41-e67a8f67c018 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.172420 Oct 04 08:56:08.535658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 255/550] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:08 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:09.106142 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b7131c45-b1ab-42b2-9827-cd95b3f26b78 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:09.106746 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b7131c45-b1ab-42b2-9827-cd95b3f26b78 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:09.113298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b7131c45-b1ab-42b2-9827-cd95b3f26b78 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:09.114270 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b7131c45-b1ab-42b2-9827-cd95b3f26b78 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:09.114685 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b7131c45-b1ab-42b2-9827-cd95b3f26b78 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:09.115375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b7131c45-b1ab-42b2-9827-cd95b3f26b78 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:09.115794 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b7131c45-b1ab-42b2-9827-cd95b3f26b78 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:09.116269 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b7131c45-b1ab-42b2-9827-cd95b3f26b78 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:09.241184 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b7131c45-b1ab-42b2-9827-cd95b3f26b78 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:09.249753 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b7131c45-b1ab-42b2-9827-cd95b3f26b78 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1503 microversion: 2.1 time: 0.148145 Oct 04 08:56:09.250611 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 296/551] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:09 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:09.399664 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-be765a96-5402-4e84-978f-2d55721120ae tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:09.401455 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-be765a96-5402-4e84-978f-2d55721120ae tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:09.411130 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be765a96-5402-4e84-978f-2d55721120ae tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:09.411828 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be765a96-5402-4e84-978f-2d55721120ae tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:09.412367 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be765a96-5402-4e84-978f-2d55721120ae tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:09.413204 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be765a96-5402-4e84-978f-2d55721120ae tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:09.413757 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be765a96-5402-4e84-978f-2d55721120ae tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:09.414289 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be765a96-5402-4e84-978f-2d55721120ae tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:09.551204 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-be765a96-5402-4e84-978f-2d55721120ae tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:09.557809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e67c84b9-58bf-4d3c-a62a-66fd6a6739c8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:09.558435 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e67c84b9-58bf-4d3c-a62a-66fd6a6739c8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:09.561585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-be765a96-5402-4e84-978f-2d55721120ae tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:09.563191 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-be765a96-5402-4e84-978f-2d55721120ae tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:09.564293 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e67c84b9-58bf-4d3c-a62a-66fd6a6739c8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:09.564419 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-be765a96-5402-4e84-978f-2d55721120ae tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.171234 Oct 04 08:56:09.564769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e67c84b9-58bf-4d3c-a62a-66fd6a6739c8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:09.564924 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 256/552] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:09 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:56:09.568214 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e67c84b9-58bf-4d3c-a62a-66fd6a6739c8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:09.569011 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e67c84b9-58bf-4d3c-a62a-66fd6a6739c8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:09.569574 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e67c84b9-58bf-4d3c-a62a-66fd6a6739c8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:09.570019 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e67c84b9-58bf-4d3c-a62a-66fd6a6739c8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:09.706210 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e67c84b9-58bf-4d3c-a62a-66fd6a6739c8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:09.714182 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e67c84b9-58bf-4d3c-a62a-66fd6a6739c8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.160262 Oct 04 08:56:09.723967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 297/553] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:09 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:10.273851 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fdfe466f-86b8-408f-b590-62ee1f1db12c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:10.274791 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-fdfe466f-86b8-408f-b590-62ee1f1db12c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:10.288064 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fdfe466f-86b8-408f-b590-62ee1f1db12c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:10.288762 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fdfe466f-86b8-408f-b590-62ee1f1db12c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:10.289207 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fdfe466f-86b8-408f-b590-62ee1f1db12c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:10.289931 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fdfe466f-86b8-408f-b590-62ee1f1db12c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:10.290393 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fdfe466f-86b8-408f-b590-62ee1f1db12c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:10.290809 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fdfe466f-86b8-408f-b590-62ee1f1db12c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:10.448760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-fdfe466f-86b8-408f-b590-62ee1f1db12c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:10.458189 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fdfe466f-86b8-408f-b590-62ee1f1db12c tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1503 microversion: 2.1 time: 0.188804 Oct 04 08:56:10.479041 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 257/554] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:10 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:10.591185 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d27eb687-38e7-456f-ba9f-9850f1008a87 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:10.592647 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d27eb687-38e7-456f-ba9f-9850f1008a87 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:10.601061 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d27eb687-38e7-456f-ba9f-9850f1008a87 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:10.603682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d27eb687-38e7-456f-ba9f-9850f1008a87 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:10.604279 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d27eb687-38e7-456f-ba9f-9850f1008a87 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:10.607238 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d27eb687-38e7-456f-ba9f-9850f1008a87 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:10.608144 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d27eb687-38e7-456f-ba9f-9850f1008a87 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:10.609171 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d27eb687-38e7-456f-ba9f-9850f1008a87 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:10.738893 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2b5eeaea-7cfc-4ed6-b209-451f4d87781f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:10.740050 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2b5eeaea-7cfc-4ed6-b209-451f4d87781f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:10.747346 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2b5eeaea-7cfc-4ed6-b209-451f4d87781f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:10.748277 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2b5eeaea-7cfc-4ed6-b209-451f4d87781f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:10.749002 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2b5eeaea-7cfc-4ed6-b209-451f4d87781f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:10.750097 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2b5eeaea-7cfc-4ed6-b209-451f4d87781f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:10.750943 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2b5eeaea-7cfc-4ed6-b209-451f4d87781f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:10.751583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2b5eeaea-7cfc-4ed6-b209-451f4d87781f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:10.782344 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d27eb687-38e7-456f-ba9f-9850f1008a87 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:10.808368 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d27eb687-38e7-456f-ba9f-9850f1008a87 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:10.810326 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d27eb687-38e7-456f-ba9f-9850f1008a87 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:10.812358 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d27eb687-38e7-456f-ba9f-9850f1008a87 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.227206 Oct 04 08:56:10.813428 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 298/555] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:10 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:11.028440 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2b5eeaea-7cfc-4ed6-b209-451f4d87781f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:11.036606 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2b5eeaea-7cfc-4ed6-b209-451f4d87781f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.302801 Oct 04 08:56:11.044658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 258/556] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:10 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:11.157560 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-b5489752-33fd-4edc-8646-800237b3b2be req-824f9009-0ed4-4b3c-b0df-47f89890e829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3065f8-4fa3-4b25-8362-7c29c79fee76", "name": "network-vif-deleted", "tag": "3609cbf8-d7b0-457d-a5c9-1e9bf12dc3b3"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:11.186239 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-b5489752-33fd-4edc-8646-800237b3b2be req-824f9009-0ed4-4b3c-b0df-47f89890e829 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:11.186728 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-b5489752-33fd-4edc-8646-800237b3b2be req-824f9009-0ed4-4b3c-b0df-47f89890e829 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:11.191770 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-b5489752-33fd-4edc-8646-800237b3b2be req-824f9009-0ed4-4b3c-b0df-47f89890e829 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:11.206436 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-b5489752-33fd-4edc-8646-800237b3b2be req-824f9009-0ed4-4b3c-b0df-47f89890e829 service nova] Creating event network-vif-deleted:3609cbf8-d7b0-457d-a5c9-1e9bf12dc3b3 for instance 4e3065f8-4fa3-4b25-8362-7c29c79fee76 on hv-cinder-84456 Oct 04 08:56:11.211606 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-b5489752-33fd-4edc-8646-800237b3b2be req-824f9009-0ed4-4b3c-b0df-47f89890e829 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060974 Oct 04 08:56:11.216431 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 299/557] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:11.487468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9b09c9f1-632d-4c7d-9b49-b7733054f6a7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:11.490488 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9b09c9f1-632d-4c7d-9b49-b7733054f6a7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:11.507214 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b09c9f1-632d-4c7d-9b49-b7733054f6a7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:11.508828 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b09c9f1-632d-4c7d-9b49-b7733054f6a7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:11.513543 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b09c9f1-632d-4c7d-9b49-b7733054f6a7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:11.514663 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b09c9f1-632d-4c7d-9b49-b7733054f6a7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:11.515426 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b09c9f1-632d-4c7d-9b49-b7733054f6a7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:11.516265 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b09c9f1-632d-4c7d-9b49-b7733054f6a7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:11.568478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b09c9f1-632d-4c7d-9b49-b7733054f6a7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:11.569638 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b09c9f1-632d-4c7d-9b49-b7733054f6a7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:11.570106 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b09c9f1-632d-4c7d-9b49-b7733054f6a7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:11.570573 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-9b09c9f1-632d-4c7d-9b49-b7733054f6a7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lazy-loading 'fault' on Instance uuid 4e3065f8-4fa3-4b25-8362-7c29c79fee76 {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:11.636671 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9b09c9f1-632d-4c7d-9b49-b7733054f6a7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b636220f1dd443eacdeb3f975736dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66d40b700e242eebfd51f2469879a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:11.648845 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9b09c9f1-632d-4c7d-9b49-b7733054f6a7 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 200 len: 1303 microversion: 2.1 time: 0.170994 Oct 04 08:56:11.649973 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 259/558] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:11 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 1303 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:11.838397 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-3e4315db-54d2-42da-b011-55f37135daff tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:11.839778 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-3e4315db-54d2-42da-b011-55f37135daff tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:11.846151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3e4315db-54d2-42da-b011-55f37135daff tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:11.846942 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3e4315db-54d2-42da-b011-55f37135daff tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:11.847635 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3e4315db-54d2-42da-b011-55f37135daff tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:11.848691 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3e4315db-54d2-42da-b011-55f37135daff tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:11.849373 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3e4315db-54d2-42da-b011-55f37135daff tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:11.849802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3e4315db-54d2-42da-b011-55f37135daff tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:11.998545 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3e4315db-54d2-42da-b011-55f37135daff tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:12.011843 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3e4315db-54d2-42da-b011-55f37135daff tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:12.013371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3e4315db-54d2-42da-b011-55f37135daff tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:12.014595 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-3e4315db-54d2-42da-b011-55f37135daff tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.180498 Oct 04 08:56:12.015290 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 300/559] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:11 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:12.075606 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-3857c0e4-519c-477d-b76a-a328dd607d66 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:12.076281 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-3857c0e4-519c-477d-b76a-a328dd607d66 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:12.083848 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3857c0e4-519c-477d-b76a-a328dd607d66 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:12.084872 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3857c0e4-519c-477d-b76a-a328dd607d66 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:12.085581 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3857c0e4-519c-477d-b76a-a328dd607d66 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:12.086669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3857c0e4-519c-477d-b76a-a328dd607d66 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:12.087391 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3857c0e4-519c-477d-b76a-a328dd607d66 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:12.088244 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3857c0e4-519c-477d-b76a-a328dd607d66 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:12.232298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-3857c0e4-519c-477d-b76a-a328dd607d66 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:12.240967 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-3857c0e4-519c-477d-b76a-a328dd607d66 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.169568 Oct 04 08:56:12.241552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 260/560] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:12 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:12.672770 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6ccaa3f1-a700-4460-866a-e7f76d451ab6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:12.673746 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6ccaa3f1-a700-4460-866a-e7f76d451ab6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] [instance: 4e3065f8-4fa3-4b25-8362-7c29c79fee76] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:12.681164 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6ccaa3f1-a700-4460-866a-e7f76d451ab6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:12.681704 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6ccaa3f1-a700-4460-866a-e7f76d451ab6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:12.682172 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6ccaa3f1-a700-4460-866a-e7f76d451ab6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:12.682901 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6ccaa3f1-a700-4460-866a-e7f76d451ab6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:12.683344 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6ccaa3f1-a700-4460-866a-e7f76d451ab6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:12.683771 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6ccaa3f1-a700-4460-866a-e7f76d451ab6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-6ccaa3f1-a700-4460-866a-e7f76d451ab6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] HTTP exception thrown: Instance 4e3065f8-4fa3-4b25-8362-7c29c79fee76 could not be found. Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6ccaa3f1-a700-4460-866a-e7f76d451ab6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Request method failure captured: Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 HTTP/1.1 Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_Tm__ubuwzp09Uu_WZ0KTVlWGI0Ddcg7ntijLdrSdGD70HnMzi-KjTue44FUX7YetAfwcXVtUYwA6fO_j-dBAl1tCsptSYzPChF-JtOTbiIV74yO_IB8xz4jGENegBMmzO9IN9BN9wdKYHCQ5rr3n2f-meJSOIHFUybVgoPIIDqWZ0 Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: d66d40b700e242eebfd51f2469879a3a Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-VolumesActionsTest-311248168 Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 08:56:12.713986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 08:56:12.716234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d66d40b700e242eebfd51f2469879a3a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d66d40b700e242eebfd51f2469879a3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d66d40b700e242eebfd51f2469879a3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d66d40b700e242eebfd51f2469879a3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:56:12.716234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-VolumesActionsTest-311248168 Oct 04 08:56:12.716234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: d66d40b700e242eebfd51f2469879a3a Oct 04 08:56:12.716234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-VolumesActionsTest-311248168 Oct 04 08:56:12.716234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-VolumesActionsTest-311248168-project Oct 04 08:56:12.716234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 08:56:12.716234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 08:56:12.716234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 3b636220f1dd443eacdeb3f975736dfc Oct 04 08:56:12.716234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-VolumesActionsTest-311248168-project Oct 04 08:56:12.716234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 08:56:12.716234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance 4e3065f8-4fa3-4b25-8362-7c29c79fee76 could not be found. Oct 04 08:56:12.716234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': '4e3065f8-4fa3-4b25-8362-7c29c79fee76'} Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3065f8-4fa3-4b25-8362-7c29c79fee76 could not be found. Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:12.716977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3065f8-4fa3-4b25-8362-7c29c79fee76 could not be found. Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3065f8-4fa3-4b25-8362-7c29c79fee76 could not be found. Oct 04 08:56:12.718215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:56:12.719705 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6ccaa3f1-a700-4460-866a-e7f76d451ab6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] Returning 404 to user: Instance 4e3065f8-4fa3-4b25-8362-7c29c79fee76 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:12.719705 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6ccaa3f1-a700-4460-866a-e7f76d451ab6 tempest-VolumesActionsTest-311248168 tempest-VolumesActionsTest-311248168-project] 10.222.0.44 "GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76" status: 404 len: 111 microversion: 2.1 time: 0.032190 Oct 04 08:56:12.719705 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 301/561] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:12 2022] GET /compute/v2.1/servers/4e3065f8-4fa3-4b25-8362-7c29c79fee76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:13.040728 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5af379f8-10a5-4c2a-a4cb-a811ff581401 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:13.042190 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5af379f8-10a5-4c2a-a4cb-a811ff581401 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:13.049970 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5af379f8-10a5-4c2a-a4cb-a811ff581401 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:13.050428 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5af379f8-10a5-4c2a-a4cb-a811ff581401 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:13.050866 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5af379f8-10a5-4c2a-a4cb-a811ff581401 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:13.051582 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5af379f8-10a5-4c2a-a4cb-a811ff581401 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:13.052071 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5af379f8-10a5-4c2a-a4cb-a811ff581401 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:13.053043 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5af379f8-10a5-4c2a-a4cb-a811ff581401 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:13.237308 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5af379f8-10a5-4c2a-a4cb-a811ff581401 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:13.246867 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5af379f8-10a5-4c2a-a4cb-a811ff581401 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:13.248448 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5af379f8-10a5-4c2a-a4cb-a811ff581401 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:13.249723 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5af379f8-10a5-4c2a-a4cb-a811ff581401 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.212991 Oct 04 08:56:13.250344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 261/562] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:13 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:13.266318 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-62368f32-7708-4d7c-ab2e-1bb14c716af8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:13.267792 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-62368f32-7708-4d7c-ab2e-1bb14c716af8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:13.275063 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62368f32-7708-4d7c-ab2e-1bb14c716af8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:13.275825 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62368f32-7708-4d7c-ab2e-1bb14c716af8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:13.276360 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62368f32-7708-4d7c-ab2e-1bb14c716af8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:13.277120 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62368f32-7708-4d7c-ab2e-1bb14c716af8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:13.277634 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62368f32-7708-4d7c-ab2e-1bb14c716af8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:13.278109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62368f32-7708-4d7c-ab2e-1bb14c716af8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:13.458657 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-62368f32-7708-4d7c-ab2e-1bb14c716af8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:13.468474 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-62368f32-7708-4d7c-ab2e-1bb14c716af8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.207078 Oct 04 08:56:13.469720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 302/563] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:13 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:14.279747 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-85898e9f-e9a9-4754-b808-881024637533 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:14.280367 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-85898e9f-e9a9-4754-b808-881024637533 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:14.289976 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85898e9f-e9a9-4754-b808-881024637533 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:14.290466 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85898e9f-e9a9-4754-b808-881024637533 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:14.290908 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85898e9f-e9a9-4754-b808-881024637533 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:14.291591 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85898e9f-e9a9-4754-b808-881024637533 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:14.292255 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85898e9f-e9a9-4754-b808-881024637533 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:14.292859 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85898e9f-e9a9-4754-b808-881024637533 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:14.430960 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-85898e9f-e9a9-4754-b808-881024637533 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:14.439538 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-85898e9f-e9a9-4754-b808-881024637533 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:14.441030 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-85898e9f-e9a9-4754-b808-881024637533 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:14.442205 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-85898e9f-e9a9-4754-b808-881024637533 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.166457 Oct 04 08:56:14.442755 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 262/564] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:14 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:14.492675 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-54540149-4d76-42c2-91e1-c9635b5caea9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:14.493571 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-54540149-4d76-42c2-91e1-c9635b5caea9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:14.499747 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-54540149-4d76-42c2-91e1-c9635b5caea9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:14.500459 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-54540149-4d76-42c2-91e1-c9635b5caea9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:14.501086 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-54540149-4d76-42c2-91e1-c9635b5caea9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:14.501797 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-54540149-4d76-42c2-91e1-c9635b5caea9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:14.502252 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-54540149-4d76-42c2-91e1-c9635b5caea9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:14.502736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-54540149-4d76-42c2-91e1-c9635b5caea9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:14.653625 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-54540149-4d76-42c2-91e1-c9635b5caea9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:14.662730 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-54540149-4d76-42c2-91e1-c9635b5caea9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.174269 Oct 04 08:56:14.663408 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 303/565] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:14 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:15.472540 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-14f1db38-e00c-45ef-8b9b-c769170570ca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:15.477925 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-14f1db38-e00c-45ef-8b9b-c769170570ca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:15.487563 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-14f1db38-e00c-45ef-8b9b-c769170570ca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:15.488136 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-14f1db38-e00c-45ef-8b9b-c769170570ca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:15.489183 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-14f1db38-e00c-45ef-8b9b-c769170570ca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:15.490127 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-14f1db38-e00c-45ef-8b9b-c769170570ca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:15.490859 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-14f1db38-e00c-45ef-8b9b-c769170570ca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:15.491369 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-14f1db38-e00c-45ef-8b9b-c769170570ca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:15.678535 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-14f1db38-e00c-45ef-8b9b-c769170570ca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:15.690053 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-14f1db38-e00c-45ef-8b9b-c769170570ca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:15.690836 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e4b53afb-bf37-497e-bf85-208c9239bbf6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:15.691481 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e4b53afb-bf37-497e-bf85-208c9239bbf6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:15.691907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-14f1db38-e00c-45ef-8b9b-c769170570ca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:15.693152 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-14f1db38-e00c-45ef-8b9b-c769170570ca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.225250 Oct 04 08:56:15.693945 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 263/566] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:15 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:15.700742 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4b53afb-bf37-497e-bf85-208c9239bbf6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:15.701753 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4b53afb-bf37-497e-bf85-208c9239bbf6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:15.703115 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4b53afb-bf37-497e-bf85-208c9239bbf6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:15.703938 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4b53afb-bf37-497e-bf85-208c9239bbf6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:15.704982 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4b53afb-bf37-497e-bf85-208c9239bbf6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:15.705933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4b53afb-bf37-497e-bf85-208c9239bbf6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:15.870798 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e4b53afb-bf37-497e-bf85-208c9239bbf6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:15.878912 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e4b53afb-bf37-497e-bf85-208c9239bbf6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.197296 Oct 04 08:56:15.879488 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 304/567] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:15 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:16.739119 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-289856c9-c859-4e53-9b2a-178f36fc0000 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:16.740590 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-289856c9-c859-4e53-9b2a-178f36fc0000 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:16.748141 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-289856c9-c859-4e53-9b2a-178f36fc0000 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:16.749060 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-289856c9-c859-4e53-9b2a-178f36fc0000 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:16.749564 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-289856c9-c859-4e53-9b2a-178f36fc0000 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:16.750346 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-289856c9-c859-4e53-9b2a-178f36fc0000 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:16.750866 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-289856c9-c859-4e53-9b2a-178f36fc0000 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:16.751356 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-289856c9-c859-4e53-9b2a-178f36fc0000 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:16.906508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2e8e1510-d47c-4b2e-b896-b642eb49a936 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:16.907122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2e8e1510-d47c-4b2e-b896-b642eb49a936 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:16.911568 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=84 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:16.915395 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2e8e1510-d47c-4b2e-b896-b642eb49a936 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:16.915906 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2e8e1510-d47c-4b2e-b896-b642eb49a936 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:16.916336 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2e8e1510-d47c-4b2e-b896-b642eb49a936 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:16.917035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2e8e1510-d47c-4b2e-b896-b642eb49a936 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:16.917478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2e8e1510-d47c-4b2e-b896-b642eb49a936 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:16.917885 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2e8e1510-d47c-4b2e-b896-b642eb49a936 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:16.932349 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-289856c9-c859-4e53-9b2a-178f36fc0000 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:16.940855 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-289856c9-c859-4e53-9b2a-178f36fc0000 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:16.944588 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-289856c9-c859-4e53-9b2a-178f36fc0000 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:16.948501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-289856c9-c859-4e53-9b2a-178f36fc0000 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.214096 Oct 04 08:56:16.952731 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 264/568] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:16 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:17.047550 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-951253873", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "networks": [{"uuid": "48ab57a6-62ab-4290-9ed2-13729cd553a5"}]}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:17.080806 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2e8e1510-d47c-4b2e-b896-b642eb49a936 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:17.088565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2e8e1510-d47c-4b2e-b896-b642eb49a936 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.185877 Oct 04 08:56:17.090495 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 305/569] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:16 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:17.122031 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.network.neutron [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] validate_networks() for [('48ab57a6-62ab-4290-9ed2-13729cd553a5', None, None, None, None, None)] {{(pid=142439) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:56:17.495269 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Flavor limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:56:17.495804 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Image limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:56:17.496474 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Flavor pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:56:17.497200 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Image pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:56:17.498127 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:56:17.511468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:17.512109 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:17.512628 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:17.513689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:17.514247 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:17.514741 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:17.532671 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Getting quotas for project 67b474ba7f7a465caa2ed14f891ac951. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:56:17.537759 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Getting quotas for user 1e44ee032c5346ec9260740bcb700007 and project 67b474ba7f7a465caa2ed14f891ac951. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:56:17.549440 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Going to run 1 instances... {{(pid=142439) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:56:17.551829 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:56:17.607146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d1552edf-8d69-4fee-802d-32a8c6019169 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563616 Oct 04 08:56:17.608597 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 265/570] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 08:56:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:56:17.623717 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0700d1c5-7c8f-49a2-93cb-1cb659e0a8c0 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:17.625030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0700d1c5-7c8f-49a2-93cb-1cb659e0a8c0 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:17.698535 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0700d1c5-7c8f-49a2-93cb-1cb659e0a8c0 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:17.707104 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0700d1c5-7c8f-49a2-93cb-1cb659e0a8c0 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1218 microversion: 2.1 time: 0.087561 Oct 04 08:56:17.708331 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 306/571] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:17 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:17.991145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2620bba1-a5c7-4730-b1b6-e3568c08fc93 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:17.996237 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2620bba1-a5c7-4730-b1b6-e3568c08fc93 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:18.005402 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2620bba1-a5c7-4730-b1b6-e3568c08fc93 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:18.006548 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2620bba1-a5c7-4730-b1b6-e3568c08fc93 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:18.007211 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2620bba1-a5c7-4730-b1b6-e3568c08fc93 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:18.008187 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2620bba1-a5c7-4730-b1b6-e3568c08fc93 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:18.008852 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2620bba1-a5c7-4730-b1b6-e3568c08fc93 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:18.009499 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2620bba1-a5c7-4730-b1b6-e3568c08fc93 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:18.111193 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-699fe211-cef8-48d9-b8bc-c7a2251d20a6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:18.111862 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-699fe211-cef8-48d9-b8bc-c7a2251d20a6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:18.125684 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-699fe211-cef8-48d9-b8bc-c7a2251d20a6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:18.126173 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-699fe211-cef8-48d9-b8bc-c7a2251d20a6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:18.126604 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-699fe211-cef8-48d9-b8bc-c7a2251d20a6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:18.127305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-699fe211-cef8-48d9-b8bc-c7a2251d20a6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:18.127794 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-699fe211-cef8-48d9-b8bc-c7a2251d20a6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:18.136445 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-699fe211-cef8-48d9-b8bc-c7a2251d20a6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:18.210335 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2620bba1-a5c7-4730-b1b6-e3568c08fc93 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:18.220405 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2620bba1-a5c7-4730-b1b6-e3568c08fc93 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:18.222239 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2620bba1-a5c7-4730-b1b6-e3568c08fc93 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:18.223409 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2620bba1-a5c7-4730-b1b6-e3568c08fc93 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.243866 Oct 04 08:56:18.223986 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 266/572] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:17 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:18.319004 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-699fe211-cef8-48d9-b8bc-c7a2251d20a6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:18.327819 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-699fe211-cef8-48d9-b8bc-c7a2251d20a6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.220385 Oct 04 08:56:18.328796 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 307/573] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:18 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:18.740696 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-93b4c523-70d7-4e34-a298-c60edc7bf5c0 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:18.741329 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-93b4c523-70d7-4e34-a298-c60edc7bf5c0 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:18.747968 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93b4c523-70d7-4e34-a298-c60edc7bf5c0 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:18.748457 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93b4c523-70d7-4e34-a298-c60edc7bf5c0 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:18.748891 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93b4c523-70d7-4e34-a298-c60edc7bf5c0 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:18.749592 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93b4c523-70d7-4e34-a298-c60edc7bf5c0 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:18.750041 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93b4c523-70d7-4e34-a298-c60edc7bf5c0 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:18.750460 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93b4c523-70d7-4e34-a298-c60edc7bf5c0 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:18.814929 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-93b4c523-70d7-4e34-a298-c60edc7bf5c0 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:18.823543 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-93b4c523-70d7-4e34-a298-c60edc7bf5c0 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1222 microversion: 2.1 time: 0.094768 Oct 04 08:56:18.824372 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 267/574] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:18 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:19.251739 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-35377b39-ae02-4a4c-847a-cf2e44ffcf24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:19.253146 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-35377b39-ae02-4a4c-847a-cf2e44ffcf24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:19.259480 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-35377b39-ae02-4a4c-847a-cf2e44ffcf24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:19.260196 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-35377b39-ae02-4a4c-847a-cf2e44ffcf24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:19.260824 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-35377b39-ae02-4a4c-847a-cf2e44ffcf24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:19.261515 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-35377b39-ae02-4a4c-847a-cf2e44ffcf24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:19.261963 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-35377b39-ae02-4a4c-847a-cf2e44ffcf24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:19.262382 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-35377b39-ae02-4a4c-847a-cf2e44ffcf24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:19.351301 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-39ef3f26-e329-4a40-a654-ba534a74153d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:19.352125 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-39ef3f26-e329-4a40-a654-ba534a74153d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:19.361696 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-39ef3f26-e329-4a40-a654-ba534a74153d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:19.362213 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-39ef3f26-e329-4a40-a654-ba534a74153d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:19.362642 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-39ef3f26-e329-4a40-a654-ba534a74153d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:19.363347 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-39ef3f26-e329-4a40-a654-ba534a74153d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:19.364169 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-39ef3f26-e329-4a40-a654-ba534a74153d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:19.364595 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-39ef3f26-e329-4a40-a654-ba534a74153d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:19.381252 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=100 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:19.424723 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-35377b39-ae02-4a4c-847a-cf2e44ffcf24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:19.438181 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-35377b39-ae02-4a4c-847a-cf2e44ffcf24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:19.439738 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-35377b39-ae02-4a4c-847a-cf2e44ffcf24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:19.441097 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-35377b39-ae02-4a4c-847a-cf2e44ffcf24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.193344 Oct 04 08:56:19.441747 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 308/575] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:19 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:19.516279 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-39ef3f26-e329-4a40-a654-ba534a74153d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:19.524041 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-39ef3f26-e329-4a40-a654-ba534a74153d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.177040 Oct 04 08:56:19.525989 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 268/576] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:19 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:19.850945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4c2993cb-dc9b-4984-a98a-29b9ffa1ef68 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:19.852067 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4c2993cb-dc9b-4984-a98a-29b9ffa1ef68 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:19.861925 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4c2993cb-dc9b-4984-a98a-29b9ffa1ef68 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:19.862718 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4c2993cb-dc9b-4984-a98a-29b9ffa1ef68 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:19.863422 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4c2993cb-dc9b-4984-a98a-29b9ffa1ef68 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:19.864967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4c2993cb-dc9b-4984-a98a-29b9ffa1ef68 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:19.865707 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4c2993cb-dc9b-4984-a98a-29b9ffa1ef68 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:19.866427 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4c2993cb-dc9b-4984-a98a-29b9ffa1ef68 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:19.932583 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4c2993cb-dc9b-4984-a98a-29b9ffa1ef68 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:19.940651 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4c2993cb-dc9b-4984-a98a-29b9ffa1ef68 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1222 microversion: 2.1 time: 0.096347 Oct 04 08:56:19.941215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 309/577] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:19 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:20.468833 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b9fcbbbf-e6f9-48c4-80bb-fecf5208e06e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:20.470341 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b9fcbbbf-e6f9-48c4-80bb-fecf5208e06e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:20.479701 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9fcbbbf-e6f9-48c4-80bb-fecf5208e06e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:20.480428 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9fcbbbf-e6f9-48c4-80bb-fecf5208e06e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:20.481048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9fcbbbf-e6f9-48c4-80bb-fecf5208e06e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:20.482062 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9fcbbbf-e6f9-48c4-80bb-fecf5208e06e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:20.482626 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9fcbbbf-e6f9-48c4-80bb-fecf5208e06e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:20.483237 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9fcbbbf-e6f9-48c4-80bb-fecf5208e06e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:20.547423 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6d0b3f32-d9ca-487a-ba4b-efc26dc2bc28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:20.548086 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6d0b3f32-d9ca-487a-ba4b-efc26dc2bc28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:20.554549 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6d0b3f32-d9ca-487a-ba4b-efc26dc2bc28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:20.555033 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6d0b3f32-d9ca-487a-ba4b-efc26dc2bc28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:20.555460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6d0b3f32-d9ca-487a-ba4b-efc26dc2bc28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:20.556188 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6d0b3f32-d9ca-487a-ba4b-efc26dc2bc28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:20.556639 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6d0b3f32-d9ca-487a-ba4b-efc26dc2bc28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:20.557055 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6d0b3f32-d9ca-487a-ba4b-efc26dc2bc28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:20.645291 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b9fcbbbf-e6f9-48c4-80bb-fecf5208e06e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:20.653675 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b9fcbbbf-e6f9-48c4-80bb-fecf5208e06e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:20.655090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b9fcbbbf-e6f9-48c4-80bb-fecf5208e06e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:20.656296 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b9fcbbbf-e6f9-48c4-80bb-fecf5208e06e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.192675 Oct 04 08:56:20.656838 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 269/578] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:20 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:20.713701 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6d0b3f32-d9ca-487a-ba4b-efc26dc2bc28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:20.721902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6d0b3f32-d9ca-487a-ba4b-efc26dc2bc28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.178387 Oct 04 08:56:20.722448 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 310/579] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:20 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:20.964185 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-03b445fa-711a-4ad1-ac2b-db0e8c857a98 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:20.964992 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-03b445fa-711a-4ad1-ac2b-db0e8c857a98 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:20.971515 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-03b445fa-711a-4ad1-ac2b-db0e8c857a98 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:20.972022 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-03b445fa-711a-4ad1-ac2b-db0e8c857a98 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:20.972929 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-03b445fa-711a-4ad1-ac2b-db0e8c857a98 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:20.973121 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-03b445fa-711a-4ad1-ac2b-db0e8c857a98 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:20.973582 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-03b445fa-711a-4ad1-ac2b-db0e8c857a98 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:20.973998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-03b445fa-711a-4ad1-ac2b-db0e8c857a98 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.044560 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-03b445fa-711a-4ad1-ac2b-db0e8c857a98 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:21.052765 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-03b445fa-711a-4ad1-ac2b-db0e8c857a98 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1222 microversion: 2.1 time: 0.093710 Oct 04 08:56:21.053326 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 270/580] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:20 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:21.682191 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f566e784-8f47-4434-b162-793d7e9e5847 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:21.682959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f566e784-8f47-4434-b162-793d7e9e5847 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:21.688828 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f566e784-8f47-4434-b162-793d7e9e5847 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.689310 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f566e784-8f47-4434-b162-793d7e9e5847 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.689784 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f566e784-8f47-4434-b162-793d7e9e5847 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.690474 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f566e784-8f47-4434-b162-793d7e9e5847 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.690923 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f566e784-8f47-4434-b162-793d7e9e5847 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.691341 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f566e784-8f47-4434-b162-793d7e9e5847 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.695225 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=100 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:21.745419 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-219e929f-d0bb-427b-83d0-6443b184a37b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:21.746016 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-219e929f-d0bb-427b-83d0-6443b184a37b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:21.753212 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-219e929f-d0bb-427b-83d0-6443b184a37b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.753697 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-219e929f-d0bb-427b-83d0-6443b184a37b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.754128 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-219e929f-d0bb-427b-83d0-6443b184a37b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.754814 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-219e929f-d0bb-427b-83d0-6443b184a37b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.755281 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-219e929f-d0bb-427b-83d0-6443b184a37b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.755699 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-219e929f-d0bb-427b-83d0-6443b184a37b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.861447 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f566e784-8f47-4434-b162-793d7e9e5847 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:21.870901 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f566e784-8f47-4434-b162-793d7e9e5847 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:21.872416 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f566e784-8f47-4434-b162-793d7e9e5847 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:21.873835 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f566e784-8f47-4434-b162-793d7e9e5847 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.195637 Oct 04 08:56:21.874840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 311/581] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:21 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:21.913683 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-219e929f-d0bb-427b-83d0-6443b184a37b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:21.921552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-219e929f-d0bb-427b-83d0-6443b184a37b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.180161 Oct 04 08:56:21.922201 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 271/582] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:21 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:22.088328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c3c5076e-9b8c-46c2-a45c-9872e9d1695a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:22.089317 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c3c5076e-9b8c-46c2-a45c-9872e9d1695a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:22.098273 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c3c5076e-9b8c-46c2-a45c-9872e9d1695a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:22.098753 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c3c5076e-9b8c-46c2-a45c-9872e9d1695a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:22.099176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c3c5076e-9b8c-46c2-a45c-9872e9d1695a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:22.099863 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c3c5076e-9b8c-46c2-a45c-9872e9d1695a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:22.100340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c3c5076e-9b8c-46c2-a45c-9872e9d1695a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:22.100754 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c3c5076e-9b8c-46c2-a45c-9872e9d1695a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:22.162519 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c3c5076e-9b8c-46c2-a45c-9872e9d1695a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:22.170201 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c3c5076e-9b8c-46c2-a45c-9872e9d1695a tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1270 microversion: 2.1 time: 0.088323 Oct 04 08:56:22.170756 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 312/583] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:22 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:22.899339 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e9e86e87-37f6-4dbf-b7f7-ec79d9b7e73a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:22.900023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e9e86e87-37f6-4dbf-b7f7-ec79d9b7e73a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:22.908765 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e9e86e87-37f6-4dbf-b7f7-ec79d9b7e73a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:22.909505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e9e86e87-37f6-4dbf-b7f7-ec79d9b7e73a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:22.910330 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e9e86e87-37f6-4dbf-b7f7-ec79d9b7e73a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:22.911024 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e9e86e87-37f6-4dbf-b7f7-ec79d9b7e73a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:22.911634 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e9e86e87-37f6-4dbf-b7f7-ec79d9b7e73a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:22.912122 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e9e86e87-37f6-4dbf-b7f7-ec79d9b7e73a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:22.945278 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f7a2cdb8-1d11-44d6-b699-b626bdecaa9f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:22.945867 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f7a2cdb8-1d11-44d6-b699-b626bdecaa9f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:22.953476 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f7a2cdb8-1d11-44d6-b699-b626bdecaa9f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:22.957795 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f7a2cdb8-1d11-44d6-b699-b626bdecaa9f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:22.958418 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f7a2cdb8-1d11-44d6-b699-b626bdecaa9f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:22.959447 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f7a2cdb8-1d11-44d6-b699-b626bdecaa9f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:22.960074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f7a2cdb8-1d11-44d6-b699-b626bdecaa9f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:22.960898 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f7a2cdb8-1d11-44d6-b699-b626bdecaa9f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:23.162524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e9e86e87-37f6-4dbf-b7f7-ec79d9b7e73a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:23.173059 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e9e86e87-37f6-4dbf-b7f7-ec79d9b7e73a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:23.174912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e9e86e87-37f6-4dbf-b7f7-ec79d9b7e73a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:23.176643 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e9e86e87-37f6-4dbf-b7f7-ec79d9b7e73a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1739 microversion: 2.20 time: 0.281360 Oct 04 08:56:23.177511 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 272/584] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:22 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:23.202625 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-bf6a2776-5f97-4518-9743-960d9e724ce9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:23.203319 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-bf6a2776-5f97-4518-9743-960d9e724ce9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:23.209907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bf6a2776-5f97-4518-9743-960d9e724ce9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:23.210525 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bf6a2776-5f97-4518-9743-960d9e724ce9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:23.211052 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bf6a2776-5f97-4518-9743-960d9e724ce9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:23.211834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bf6a2776-5f97-4518-9743-960d9e724ce9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:23.212398 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bf6a2776-5f97-4518-9743-960d9e724ce9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:23.213078 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bf6a2776-5f97-4518-9743-960d9e724ce9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:23.243079 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f7a2cdb8-1d11-44d6-b699-b626bdecaa9f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:23.253885 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f7a2cdb8-1d11-44d6-b699-b626bdecaa9f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.312580 Oct 04 08:56:23.254940 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 313/585] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:22 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:23.289408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-bf6a2776-5f97-4518-9743-960d9e724ce9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:23.310191 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-bf6a2776-5f97-4518-9743-960d9e724ce9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1278 microversion: 2.1 time: 0.112328 Oct 04 08:56:23.319610 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 273/586] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:23 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1278 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:24.204014 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-de087268-7e5d-4823-83d1-f2549bf7673c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:24.205308 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-de087268-7e5d-4823-83d1-f2549bf7673c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:24.216055 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de087268-7e5d-4823-83d1-f2549bf7673c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.216872 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de087268-7e5d-4823-83d1-f2549bf7673c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.221564 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de087268-7e5d-4823-83d1-f2549bf7673c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.222946 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de087268-7e5d-4823-83d1-f2549bf7673c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.224288 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de087268-7e5d-4823-83d1-f2549bf7673c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.224923 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de087268-7e5d-4823-83d1-f2549bf7673c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.277947 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-310a6fd0-3596-42d8-b200-3c37231f056e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:24.279278 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-310a6fd0-3596-42d8-b200-3c37231f056e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:24.286707 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-310a6fd0-3596-42d8-b200-3c37231f056e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.287548 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-310a6fd0-3596-42d8-b200-3c37231f056e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.288205 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-310a6fd0-3596-42d8-b200-3c37231f056e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.289169 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-310a6fd0-3596-42d8-b200-3c37231f056e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.289866 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-310a6fd0-3596-42d8-b200-3c37231f056e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.290487 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-310a6fd0-3596-42d8-b200-3c37231f056e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.538976 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-de087268-7e5d-4823-83d1-f2549bf7673c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:24.553185 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-de087268-7e5d-4823-83d1-f2549bf7673c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:24.555206 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-de087268-7e5d-4823-83d1-f2549bf7673c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:24.556703 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-de087268-7e5d-4823-83d1-f2549bf7673c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1721 microversion: 2.20 time: 0.356781 Oct 04 08:56:24.557811 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 314/587] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:24 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1721 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:24.563108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-faf0c01f-c448-4b9f-a3c9-acfca1d4b508 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:24.563736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-faf0c01f-c448-4b9f-a3c9-acfca1d4b508 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:24.571224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faf0c01f-c448-4b9f-a3c9-acfca1d4b508 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.571974 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faf0c01f-c448-4b9f-a3c9-acfca1d4b508 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.572897 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faf0c01f-c448-4b9f-a3c9-acfca1d4b508 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.573941 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faf0c01f-c448-4b9f-a3c9-acfca1d4b508 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.574721 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faf0c01f-c448-4b9f-a3c9-acfca1d4b508 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.575345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-faf0c01f-c448-4b9f-a3c9-acfca1d4b508 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.595417 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-310a6fd0-3596-42d8-b200-3c37231f056e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:24.608655 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-310a6fd0-3596-42d8-b200-3c37231f056e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.334675 Oct 04 08:56:24.610348 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 274/588] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:24 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:24.771777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-faf0c01f-c448-4b9f-a3c9-acfca1d4b508 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:24.782905 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-faf0c01f-c448-4b9f-a3c9-acfca1d4b508 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.223522 Oct 04 08:56:24.783688 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 315/589] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:24 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:25.082630 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-5ca55226-1b64-45d8-a94f-454166ccd806 req-85b62f0e-9bce-4a87-adf9-895e7cb02283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a2c88e-2a5a-4452-9fef-e8275214033e", "tag": "d9944987-01b7-4522-a286-29b930805806"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:25.094129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-5ca55226-1b64-45d8-a94f-454166ccd806 req-85b62f0e-9bce-4a87-adf9-895e7cb02283 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.095081 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-5ca55226-1b64-45d8-a94f-454166ccd806 req-85b62f0e-9bce-4a87-adf9-895e7cb02283 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.095808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-5ca55226-1b64-45d8-a94f-454166ccd806 req-85b62f0e-9bce-4a87-adf9-895e7cb02283 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.109318 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-5ca55226-1b64-45d8-a94f-454166ccd806 req-85b62f0e-9bce-4a87-adf9-895e7cb02283 service nova] Creating event network-changed:d9944987-01b7-4522-a286-29b930805806 for instance c9a2c88e-2a5a-4452-9fef-e8275214033e on hv-cinder-84456 Oct 04 08:56:25.116420 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-5ca55226-1b64-45d8-a94f-454166ccd806 req-85b62f0e-9bce-4a87-adf9-895e7cb02283 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037706 Oct 04 08:56:25.118071 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 275/590] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:25.583836 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-cc2dab7e-83f9-4fdb-b722-c278b299200e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:25.584567 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cc2dab7e-83f9-4fdb-b722-c278b299200e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:25.591065 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cc2dab7e-83f9-4fdb-b722-c278b299200e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.591568 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cc2dab7e-83f9-4fdb-b722-c278b299200e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.592041 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cc2dab7e-83f9-4fdb-b722-c278b299200e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.592788 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cc2dab7e-83f9-4fdb-b722-c278b299200e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.593214 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cc2dab7e-83f9-4fdb-b722-c278b299200e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.593637 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cc2dab7e-83f9-4fdb-b722-c278b299200e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.638761 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-551bf002-d427-4da2-97d9-bf19ca096b58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:25.639852 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-551bf002-d427-4da2-97d9-bf19ca096b58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:25.647529 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-551bf002-d427-4da2-97d9-bf19ca096b58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.648360 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-551bf002-d427-4da2-97d9-bf19ca096b58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.648950 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-551bf002-d427-4da2-97d9-bf19ca096b58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.649838 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-551bf002-d427-4da2-97d9-bf19ca096b58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.650305 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-551bf002-d427-4da2-97d9-bf19ca096b58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.650731 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-551bf002-d427-4da2-97d9-bf19ca096b58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.810347 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cc2dab7e-83f9-4fdb-b722-c278b299200e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:25.819152 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cc2dab7e-83f9-4fdb-b722-c278b299200e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:25.820792 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cc2dab7e-83f9-4fdb-b722-c278b299200e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:25.822406 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-cc2dab7e-83f9-4fdb-b722-c278b299200e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1721 microversion: 2.20 time: 0.242791 Oct 04 08:56:25.823984 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 316/591] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:25 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:25.828200 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-066bb57a-996f-41e9-a215-e965b878cd15 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:25.829100 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-066bb57a-996f-41e9-a215-e965b878cd15 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:25.835772 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-066bb57a-996f-41e9-a215-e965b878cd15 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.836355 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-066bb57a-996f-41e9-a215-e965b878cd15 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.836852 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-066bb57a-996f-41e9-a215-e965b878cd15 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.837612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-066bb57a-996f-41e9-a215-e965b878cd15 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.838129 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-066bb57a-996f-41e9-a215-e965b878cd15 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.838607 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-066bb57a-996f-41e9-a215-e965b878cd15 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.854815 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-551bf002-d427-4da2-97d9-bf19ca096b58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:25.862738 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-551bf002-d427-4da2-97d9-bf19ca096b58 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.228276 Oct 04 08:56:25.878274 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 276/592] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:25 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:25.997485 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-066bb57a-996f-41e9-a215-e965b878cd15 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:26.013139 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-066bb57a-996f-41e9-a215-e965b878cd15 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.187832 Oct 04 08:56:26.024733 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 317/593] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:25 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:26.731364 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-9776c775-0078-4ada-b201-bdcea77f32dd req-84c27bb9-5061-404c-ad4d-22eb563caaee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c126bbd8-579f-48ce-88d5-29b61bd75c28", "name": "network-vif-plugged", "status": "completed", "tag": "aebd8c5b-67fa-48a2-be49-86c0fe14a590"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:26.747268 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-9776c775-0078-4ada-b201-bdcea77f32dd req-84c27bb9-5061-404c-ad4d-22eb563caaee service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:26.748422 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-9776c775-0078-4ada-b201-bdcea77f32dd req-84c27bb9-5061-404c-ad4d-22eb563caaee service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:26.749043 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-9776c775-0078-4ada-b201-bdcea77f32dd req-84c27bb9-5061-404c-ad4d-22eb563caaee service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:26.762000 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-9776c775-0078-4ada-b201-bdcea77f32dd req-84c27bb9-5061-404c-ad4d-22eb563caaee service nova] Creating event network-vif-plugged:aebd8c5b-67fa-48a2-be49-86c0fe14a590 for instance c126bbd8-579f-48ce-88d5-29b61bd75c28 on hv-cinder-84456 Oct 04 08:56:26.767819 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-9776c775-0078-4ada-b201-bdcea77f32dd req-84c27bb9-5061-404c-ad4d-22eb563caaee service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040386 Oct 04 08:56:26.768681 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 277/594] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:26.857746 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-595e0f3e-4bc2-435e-83bd-1fff9d23b386 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:26.859033 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-595e0f3e-4bc2-435e-83bd-1fff9d23b386 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:26.868165 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-595e0f3e-4bc2-435e-83bd-1fff9d23b386 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:26.875501 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-595e0f3e-4bc2-435e-83bd-1fff9d23b386 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:26.876872 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-595e0f3e-4bc2-435e-83bd-1fff9d23b386 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:26.878515 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-595e0f3e-4bc2-435e-83bd-1fff9d23b386 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:26.879639 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-595e0f3e-4bc2-435e-83bd-1fff9d23b386 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:26.880516 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-595e0f3e-4bc2-435e-83bd-1fff9d23b386 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:26.888897 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a8edfcc2-34b7-4799-b45e-d7920ea844b4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:26.889111 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a8edfcc2-34b7-4799-b45e-d7920ea844b4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:26.911853 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a8edfcc2-34b7-4799-b45e-d7920ea844b4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:26.912947 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a8edfcc2-34b7-4799-b45e-d7920ea844b4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:26.915698 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a8edfcc2-34b7-4799-b45e-d7920ea844b4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:26.921252 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a8edfcc2-34b7-4799-b45e-d7920ea844b4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:26.923714 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a8edfcc2-34b7-4799-b45e-d7920ea844b4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:26.924371 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a8edfcc2-34b7-4799-b45e-d7920ea844b4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:27.219564 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-595e0f3e-4bc2-435e-83bd-1fff9d23b386 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:27.228146 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-595e0f3e-4bc2-435e-83bd-1fff9d23b386 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:27.230431 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-595e0f3e-4bc2-435e-83bd-1fff9d23b386 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:27.231851 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-595e0f3e-4bc2-435e-83bd-1fff9d23b386 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1724 microversion: 2.20 time: 0.384001 Oct 04 08:56:27.232921 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 318/595] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:26 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1724 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:27.237990 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7297c374-11a4-426e-af5b-b78c35f4d6b2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:27.239040 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7297c374-11a4-426e-af5b-b78c35f4d6b2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:27.245830 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7297c374-11a4-426e-af5b-b78c35f4d6b2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:27.246386 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7297c374-11a4-426e-af5b-b78c35f4d6b2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:27.247020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7297c374-11a4-426e-af5b-b78c35f4d6b2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:27.247952 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7297c374-11a4-426e-af5b-b78c35f4d6b2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:27.248587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7297c374-11a4-426e-af5b-b78c35f4d6b2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:27.249216 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7297c374-11a4-426e-af5b-b78c35f4d6b2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:27.329247 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a8edfcc2-34b7-4799-b45e-d7920ea844b4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:27.344040 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a8edfcc2-34b7-4799-b45e-d7920ea844b4 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.461598 Oct 04 08:56:27.345039 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 278/596] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:26 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:27.350322 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d13338a5-c956-4236-a3b0-68073c47963b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b621a97d-ecfc-4b91-9e90-048f48b7794f"}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:27.352734 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d13338a5-c956-4236-a3b0-68073c47963b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:27.357870 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:27.359700 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d13338a5-c956-4236-a3b0-68073c47963b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:27.360335 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d13338a5-c956-4236-a3b0-68073c47963b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:27.360842 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d13338a5-c956-4236-a3b0-68073c47963b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:27.361716 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d13338a5-c956-4236-a3b0-68073c47963b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:27.362267 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d13338a5-c956-4236-a3b0-68073c47963b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:27.362758 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d13338a5-c956-4236-a3b0-68073c47963b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:27.526527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:27.544161 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=6 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:27.706626 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:27.791764 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7297c374-11a4-426e-af5b-b78c35f4d6b2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:27.800471 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7297c374-11a4-426e-af5b-b78c35f4d6b2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.566223 Oct 04 08:56:27.804816 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 319/597] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:27 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:27.866579 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d13338a5-c956-4236-a3b0-68073c47963b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "POST /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.520058 Oct 04 08:56:27.870260 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 279/598] 10.222.0.44 () {62 vars in 1364 bytes} [Tue Oct 4 08:56:27 2022] POST /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments => generated 188 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:56:28.030813 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c0dd7707-7d3e-40da-bd3b-77180eee729d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:28.031411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c0dd7707-7d3e-40da-bd3b-77180eee729d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:28.037593 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0dd7707-7d3e-40da-bd3b-77180eee729d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.038092 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0dd7707-7d3e-40da-bd3b-77180eee729d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.038516 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0dd7707-7d3e-40da-bd3b-77180eee729d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.039209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0dd7707-7d3e-40da-bd3b-77180eee729d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.039659 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0dd7707-7d3e-40da-bd3b-77180eee729d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.040108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0dd7707-7d3e-40da-bd3b-77180eee729d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.090113 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c0dd7707-7d3e-40da-bd3b-77180eee729d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=142438) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 08:56:28.176334 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c0dd7707-7d3e-40da-bd3b-77180eee729d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "POST /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/action" status: 202 len: 0 microversion: 2.20 time: 0.149261 Oct 04 08:56:28.177575 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 320/599] 10.222.0.44 () {62 vars in 1319 bytes} [Tue Oct 4 08:56:28 2022] POST /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:56:28.185048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8aaea7d6-6034-490a-b49f-08a87e64e897 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:28.188151 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8aaea7d6-6034-490a-b49f-08a87e64e897 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:28.196323 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8aaea7d6-6034-490a-b49f-08a87e64e897 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.198159 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8aaea7d6-6034-490a-b49f-08a87e64e897 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.198699 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8aaea7d6-6034-490a-b49f-08a87e64e897 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.199620 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8aaea7d6-6034-490a-b49f-08a87e64e897 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.200170 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8aaea7d6-6034-490a-b49f-08a87e64e897 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.200653 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8aaea7d6-6034-490a-b49f-08a87e64e897 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.339790 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8aaea7d6-6034-490a-b49f-08a87e64e897 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:28.349805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8aaea7d6-6034-490a-b49f-08a87e64e897 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:28.351656 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8aaea7d6-6034-490a-b49f-08a87e64e897 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:28.353144 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8aaea7d6-6034-490a-b49f-08a87e64e897 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1750 microversion: 2.20 time: 0.172057 Oct 04 08:56:28.361809 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 280/600] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:28 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:28.367061 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a3bec168-c6a2-4f99-9f61-cbc0508d4810 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:28.367939 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a3bec168-c6a2-4f99-9f61-cbc0508d4810 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:28.375692 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a3bec168-c6a2-4f99-9f61-cbc0508d4810 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.376199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a3bec168-c6a2-4f99-9f61-cbc0508d4810 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.376872 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a3bec168-c6a2-4f99-9f61-cbc0508d4810 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.377573 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a3bec168-c6a2-4f99-9f61-cbc0508d4810 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.378024 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a3bec168-c6a2-4f99-9f61-cbc0508d4810 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.378445 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a3bec168-c6a2-4f99-9f61-cbc0508d4810 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.543487 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-a3bec168-c6a2-4f99-9f61-cbc0508d4810 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:28.561085 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a3bec168-c6a2-4f99-9f61-cbc0508d4810 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.197430 Oct 04 08:56:28.566311 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 321/601] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:28 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:28.811403 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-fce458e0-2a8d-4278-ba9b-25f34f0ef6e7 req-0c801d28-eb57-40d3-ab3b-ab42e4741e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4454abc-67a9-470b-bdce-5a69bc51bbed", "name": "network-vif-unplugged", "status": "completed", "tag": "a52bd48f-906c-4b87-b387-01e1bfaa69c2"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:28.830231 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d31fdd60-bfa0-4edb-82bc-353f3ae9e3d4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:28.830843 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d31fdd60-bfa0-4edb-82bc-353f3ae9e3d4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:28.844756 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d31fdd60-bfa0-4edb-82bc-353f3ae9e3d4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.845245 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d31fdd60-bfa0-4edb-82bc-353f3ae9e3d4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.845671 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d31fdd60-bfa0-4edb-82bc-353f3ae9e3d4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.846372 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d31fdd60-bfa0-4edb-82bc-353f3ae9e3d4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.846809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d31fdd60-bfa0-4edb-82bc-353f3ae9e3d4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.849807 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-fce458e0-2a8d-4278-ba9b-25f34f0ef6e7 req-0c801d28-eb57-40d3-ab3b-ab42e4741e39 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.851877 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d31fdd60-bfa0-4edb-82bc-353f3ae9e3d4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.852293 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-fce458e0-2a8d-4278-ba9b-25f34f0ef6e7 req-0c801d28-eb57-40d3-ab3b-ab42e4741e39 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.853495 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-fce458e0-2a8d-4278-ba9b-25f34f0ef6e7 req-0c801d28-eb57-40d3-ab3b-ab42e4741e39 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.870270 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.compute.server_external_events [req-fce458e0-2a8d-4278-ba9b-25f34f0ef6e7 req-0c801d28-eb57-40d3-ab3b-ab42e4741e39 service nova] Unable to find a host for instance f4454abc-67a9-470b-bdce-5a69bc51bbed. Dropping event network-vif-unplugged {{(pid=142439) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 08:56:28.871189 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-fce458e0-2a8d-4278-ba9b-25f34f0ef6e7 req-0c801d28-eb57-40d3-ab3b-ab42e4741e39 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.066066 Oct 04 08:56:28.872045 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 281/602] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 68 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 08:56:29.045189 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d31fdd60-bfa0-4edb-82bc-353f3ae9e3d4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:29.055936 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d31fdd60-bfa0-4edb-82bc-353f3ae9e3d4 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.226542 Oct 04 08:56:29.055936 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 322/603] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:28 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:29.380047 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-52c139cf-2335-4528-8838-19bec94cdb44 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:29.380652 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-52c139cf-2335-4528-8838-19bec94cdb44 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:29.392222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-52c139cf-2335-4528-8838-19bec94cdb44 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:29.393015 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-52c139cf-2335-4528-8838-19bec94cdb44 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:29.393444 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-52c139cf-2335-4528-8838-19bec94cdb44 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:29.394145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-52c139cf-2335-4528-8838-19bec94cdb44 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:29.394705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-52c139cf-2335-4528-8838-19bec94cdb44 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:29.395126 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-52c139cf-2335-4528-8838-19bec94cdb44 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:29.565352 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-52c139cf-2335-4528-8838-19bec94cdb44 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:29.577893 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-52c139cf-2335-4528-8838-19bec94cdb44 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:29.579678 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-52c139cf-2335-4528-8838-19bec94cdb44 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:29.580943 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-52c139cf-2335-4528-8838-19bec94cdb44 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1750 microversion: 2.20 time: 0.205036 Oct 04 08:56:29.582131 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 282/604] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:29 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1750 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:29.591247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-effe5446-21c7-4f30-baf8-263f14d96b19 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:29.592154 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-effe5446-21c7-4f30-baf8-263f14d96b19 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:29.601360 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-effe5446-21c7-4f30-baf8-263f14d96b19 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:29.602474 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-effe5446-21c7-4f30-baf8-263f14d96b19 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:29.603265 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-effe5446-21c7-4f30-baf8-263f14d96b19 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:29.604495 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-effe5446-21c7-4f30-baf8-263f14d96b19 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:29.605116 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-effe5446-21c7-4f30-baf8-263f14d96b19 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:29.605714 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-effe5446-21c7-4f30-baf8-263f14d96b19 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:29.754427 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-effe5446-21c7-4f30-baf8-263f14d96b19 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:29.763005 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-effe5446-21c7-4f30-baf8-263f14d96b19 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.175650 Oct 04 08:56:29.771844 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 323/605] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:29 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:30.086714 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-505eddc1-b66d-4cee-8fd2-c23c0409fa04 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:30.087736 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-505eddc1-b66d-4cee-8fd2-c23c0409fa04 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:30.095732 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-505eddc1-b66d-4cee-8fd2-c23c0409fa04 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:30.096277 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-505eddc1-b66d-4cee-8fd2-c23c0409fa04 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:30.096939 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-505eddc1-b66d-4cee-8fd2-c23c0409fa04 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:30.098067 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-505eddc1-b66d-4cee-8fd2-c23c0409fa04 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:30.098715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-505eddc1-b66d-4cee-8fd2-c23c0409fa04 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:30.099581 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-505eddc1-b66d-4cee-8fd2-c23c0409fa04 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:30.261395 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-505eddc1-b66d-4cee-8fd2-c23c0409fa04 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:30.275168 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-505eddc1-b66d-4cee-8fd2-c23c0409fa04 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.195410 Oct 04 08:56:30.276872 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 283/606] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:30 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:30.608377 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-25640de0-7ba0-4b6f-a8c9-a1e6e3d19613 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:30.610465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-25640de0-7ba0-4b6f-a8c9-a1e6e3d19613 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:30.619032 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-25640de0-7ba0-4b6f-a8c9-a1e6e3d19613 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:30.619919 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-25640de0-7ba0-4b6f-a8c9-a1e6e3d19613 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:30.621516 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-25640de0-7ba0-4b6f-a8c9-a1e6e3d19613 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:30.622852 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-25640de0-7ba0-4b6f-a8c9-a1e6e3d19613 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:30.623899 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-25640de0-7ba0-4b6f-a8c9-a1e6e3d19613 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:30.626140 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-25640de0-7ba0-4b6f-a8c9-a1e6e3d19613 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:30.780590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-25640de0-7ba0-4b6f-a8c9-a1e6e3d19613 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:30.791568 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-01e030d7-f773-4a2b-981e-600179ab89b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:30.795931 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-01e030d7-f773-4a2b-981e-600179ab89b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:30.801867 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-25640de0-7ba0-4b6f-a8c9-a1e6e3d19613 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:30.803439 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-25640de0-7ba0-4b6f-a8c9-a1e6e3d19613 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:30.804748 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-25640de0-7ba0-4b6f-a8c9-a1e6e3d19613 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1750 microversion: 2.20 time: 0.202414 Oct 04 08:56:30.805656 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 324/607] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:30 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1750 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:30.814799 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-01e030d7-f773-4a2b-981e-600179ab89b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:30.815453 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-01e030d7-f773-4a2b-981e-600179ab89b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:30.816019 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-01e030d7-f773-4a2b-981e-600179ab89b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:30.816959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-01e030d7-f773-4a2b-981e-600179ab89b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:30.817507 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-01e030d7-f773-4a2b-981e-600179ab89b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:30.818169 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-01e030d7-f773-4a2b-981e-600179ab89b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:30.842311 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:30.963706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-01e030d7-f773-4a2b-981e-600179ab89b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:30.980496 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-01e030d7-f773-4a2b-981e-600179ab89b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.197967 Oct 04 08:56:30.982116 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 284/608] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:30 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:31.304958 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d55420fa-9135-4fa7-809e-1f1e98979a8e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:31.306195 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d55420fa-9135-4fa7-809e-1f1e98979a8e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:31.315066 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d55420fa-9135-4fa7-809e-1f1e98979a8e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:31.315902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d55420fa-9135-4fa7-809e-1f1e98979a8e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:31.316800 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d55420fa-9135-4fa7-809e-1f1e98979a8e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:31.317749 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d55420fa-9135-4fa7-809e-1f1e98979a8e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:31.318289 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d55420fa-9135-4fa7-809e-1f1e98979a8e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:31.318712 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d55420fa-9135-4fa7-809e-1f1e98979a8e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:31.475369 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d55420fa-9135-4fa7-809e-1f1e98979a8e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:31.484359 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d55420fa-9135-4fa7-809e-1f1e98979a8e tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.183345 Oct 04 08:56:31.485517 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 325/609] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:31 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:31.833640 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a0bd6ecf-8524-46fe-b805-5ff703b40ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:31.834248 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a0bd6ecf-8524-46fe-b805-5ff703b40ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:31.841435 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0bd6ecf-8524-46fe-b805-5ff703b40ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:31.842252 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0bd6ecf-8524-46fe-b805-5ff703b40ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:31.842711 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0bd6ecf-8524-46fe-b805-5ff703b40ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:31.843459 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0bd6ecf-8524-46fe-b805-5ff703b40ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:31.843929 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0bd6ecf-8524-46fe-b805-5ff703b40ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:31.844384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0bd6ecf-8524-46fe-b805-5ff703b40ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:32.006065 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9de01b13-29a6-47fc-a3d1-28cd3aa947ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:32.008304 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9de01b13-29a6-47fc-a3d1-28cd3aa947ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:32.019455 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9de01b13-29a6-47fc-a3d1-28cd3aa947ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:32.019987 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9de01b13-29a6-47fc-a3d1-28cd3aa947ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:32.020424 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9de01b13-29a6-47fc-a3d1-28cd3aa947ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:32.021130 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9de01b13-29a6-47fc-a3d1-28cd3aa947ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:32.021725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9de01b13-29a6-47fc-a3d1-28cd3aa947ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:32.022154 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9de01b13-29a6-47fc-a3d1-28cd3aa947ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:32.081036 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a0bd6ecf-8524-46fe-b805-5ff703b40ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:32.090400 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a0bd6ecf-8524-46fe-b805-5ff703b40ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:32.092386 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a0bd6ecf-8524-46fe-b805-5ff703b40ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:32.093981 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a0bd6ecf-8524-46fe-b805-5ff703b40ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1752 microversion: 2.20 time: 0.264270 Oct 04 08:56:32.094547 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 285/610] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:31 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1752 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:32.184409 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9de01b13-29a6-47fc-a3d1-28cd3aa947ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:32.188327 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:32.195285 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-9de01b13-29a6-47fc-a3d1-28cd3aa947ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1263 microversion: 2.1 time: 0.194349 Oct 04 08:56:32.195990 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 326/611] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:31 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1263 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:32.509254 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-dc6bbbcc-1d2b-4732-89b5-d6c18a4a8d09 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:32.509866 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-dc6bbbcc-1d2b-4732-89b5-d6c18a4a8d09 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:32.516323 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc6bbbcc-1d2b-4732-89b5-d6c18a4a8d09 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:32.516846 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc6bbbcc-1d2b-4732-89b5-d6c18a4a8d09 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:32.517281 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc6bbbcc-1d2b-4732-89b5-d6c18a4a8d09 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:32.517983 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc6bbbcc-1d2b-4732-89b5-d6c18a4a8d09 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:32.518430 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc6bbbcc-1d2b-4732-89b5-d6c18a4a8d09 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:32.518838 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc6bbbcc-1d2b-4732-89b5-d6c18a4a8d09 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:32.694022 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dc6bbbcc-1d2b-4732-89b5-d6c18a4a8d09 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:32.705463 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-dc6bbbcc-1d2b-4732-89b5-d6c18a4a8d09 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.200677 Oct 04 08:56:32.706424 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 286/612] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:32 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:33.122439 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-23187082-ecee-478d-8731-c9c9eba70601 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:33.124342 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-23187082-ecee-478d-8731-c9c9eba70601 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:33.134239 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23187082-ecee-478d-8731-c9c9eba70601 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:33.135065 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23187082-ecee-478d-8731-c9c9eba70601 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:33.135822 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23187082-ecee-478d-8731-c9c9eba70601 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:33.136953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23187082-ecee-478d-8731-c9c9eba70601 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:33.137576 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23187082-ecee-478d-8731-c9c9eba70601 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:33.138161 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-23187082-ecee-478d-8731-c9c9eba70601 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:33.218411 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f99d0062-db98-41b0-b452-c87b018ee402 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:33.220327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f99d0062-db98-41b0-b452-c87b018ee402 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:33.229307 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f99d0062-db98-41b0-b452-c87b018ee402 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:33.235180 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f99d0062-db98-41b0-b452-c87b018ee402 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:33.235949 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f99d0062-db98-41b0-b452-c87b018ee402 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:33.237819 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f99d0062-db98-41b0-b452-c87b018ee402 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:33.239821 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f99d0062-db98-41b0-b452-c87b018ee402 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:33.240460 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f99d0062-db98-41b0-b452-c87b018ee402 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:33.538194 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f99d0062-db98-41b0-b452-c87b018ee402 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:33.551033 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-23187082-ecee-478d-8731-c9c9eba70601 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:33.553621 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f99d0062-db98-41b0-b452-c87b018ee402 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1449 microversion: 2.1 time: 0.339195 Oct 04 08:56:33.554727 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 287/613] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:33 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1449 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:33.561469 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-23187082-ecee-478d-8731-c9c9eba70601 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:33.563047 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-23187082-ecee-478d-8731-c9c9eba70601 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:33.564330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-23187082-ecee-478d-8731-c9c9eba70601 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1752 microversion: 2.20 time: 0.447817 Oct 04 08:56:33.564947 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 327/614] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:33 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1752 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:33.576461 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-41589e6c-0382-41b3-91db-9571f32903b8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:33.577158 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-41589e6c-0382-41b3-91db-9571f32903b8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:33.583216 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-41589e6c-0382-41b3-91db-9571f32903b8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:33.583766 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-41589e6c-0382-41b3-91db-9571f32903b8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:33.584323 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-41589e6c-0382-41b3-91db-9571f32903b8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:33.585075 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-41589e6c-0382-41b3-91db-9571f32903b8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:33.585611 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-41589e6c-0382-41b3-91db-9571f32903b8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:33.586092 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-41589e6c-0382-41b3-91db-9571f32903b8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:33.729451 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-41589e6c-0382-41b3-91db-9571f32903b8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:33.730492 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5c39d75b-0345-44a5-977d-1c7a32941968 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:33.731189 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5c39d75b-0345-44a5-977d-1c7a32941968 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:33.738227 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-41589e6c-0382-41b3-91db-9571f32903b8 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1449 microversion: 2.1 time: 0.165439 Oct 04 08:56:33.740372 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 288/615] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:33 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:33.756573 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c39d75b-0345-44a5-977d-1c7a32941968 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:33.757208 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c39d75b-0345-44a5-977d-1c7a32941968 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:33.757689 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c39d75b-0345-44a5-977d-1c7a32941968 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:33.758434 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c39d75b-0345-44a5-977d-1c7a32941968 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:33.758894 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c39d75b-0345-44a5-977d-1c7a32941968 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:33.759928 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5c39d75b-0345-44a5-977d-1c7a32941968 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:34.059261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5c39d75b-0345-44a5-977d-1c7a32941968 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:34.080128 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5c39d75b-0345-44a5-977d-1c7a32941968 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.353902 Oct 04 08:56:34.100574 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 328/616] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:33 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:34.594137 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f2c90098-dbf9-431c-af8e-3d2c4de359e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:34.595472 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f2c90098-dbf9-431c-af8e-3d2c4de359e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:34.602302 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f2c90098-dbf9-431c-af8e-3d2c4de359e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:34.603088 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f2c90098-dbf9-431c-af8e-3d2c4de359e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:34.603737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f2c90098-dbf9-431c-af8e-3d2c4de359e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:34.604659 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f2c90098-dbf9-431c-af8e-3d2c4de359e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:34.605454 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f2c90098-dbf9-431c-af8e-3d2c4de359e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:34.606071 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f2c90098-dbf9-431c-af8e-3d2c4de359e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:34.838688 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-b27a748e-eabd-4ea1-9d02-b332dee5c4d7 req-96eb158c-7fd9-4e98-9f12-af5f55aef338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a2c88e-2a5a-4452-9fef-e8275214033e", "name": "network-vif-plugged", "status": "completed", "tag": "d9944987-01b7-4522-a286-29b930805806"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:34.862349 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-b27a748e-eabd-4ea1-9d02-b332dee5c4d7 req-96eb158c-7fd9-4e98-9f12-af5f55aef338 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:34.865732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-b27a748e-eabd-4ea1-9d02-b332dee5c4d7 req-96eb158c-7fd9-4e98-9f12-af5f55aef338 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:34.871376 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-b27a748e-eabd-4ea1-9d02-b332dee5c4d7 req-96eb158c-7fd9-4e98-9f12-af5f55aef338 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:34.904286 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-b27a748e-eabd-4ea1-9d02-b332dee5c4d7 req-96eb158c-7fd9-4e98-9f12-af5f55aef338 service nova] Creating event network-vif-plugged:d9944987-01b7-4522-a286-29b930805806 for instance c9a2c88e-2a5a-4452-9fef-e8275214033e on hv-cinder-84456 Oct 04 08:56:34.912898 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-b27a748e-eabd-4ea1-9d02-b332dee5c4d7 req-96eb158c-7fd9-4e98-9f12-af5f55aef338 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081942 Oct 04 08:56:34.912898 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 329/617] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:34.965861 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f2c90098-dbf9-431c-af8e-3d2c4de359e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:34.978998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f2c90098-dbf9-431c-af8e-3d2c4de359e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:34.981745 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f2c90098-dbf9-431c-af8e-3d2c4de359e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:34.983163 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f2c90098-dbf9-431c-af8e-3d2c4de359e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.392972 Oct 04 08:56:35.012470 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 289/618] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:34 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:35.112506 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1738d1ed-6357-4f9b-9f54-11e55dd91587 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:35.114585 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1738d1ed-6357-4f9b-9f54-11e55dd91587 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:35.126446 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1738d1ed-6357-4f9b-9f54-11e55dd91587 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:35.127253 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1738d1ed-6357-4f9b-9f54-11e55dd91587 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:35.128172 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1738d1ed-6357-4f9b-9f54-11e55dd91587 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:35.129150 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1738d1ed-6357-4f9b-9f54-11e55dd91587 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:35.129945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1738d1ed-6357-4f9b-9f54-11e55dd91587 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:35.139107 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1738d1ed-6357-4f9b-9f54-11e55dd91587 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:35.452691 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1738d1ed-6357-4f9b-9f54-11e55dd91587 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:35.464096 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1738d1ed-6357-4f9b-9f54-11e55dd91587 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.360152 Oct 04 08:56:35.465245 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 330/619] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:35 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:36.022180 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-487c2c83-ae68-4c4a-aa23-c6e406ebb065 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:36.022822 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-487c2c83-ae68-4c4a-aa23-c6e406ebb065 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:36.029806 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-487c2c83-ae68-4c4a-aa23-c6e406ebb065 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:36.030588 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-487c2c83-ae68-4c4a-aa23-c6e406ebb065 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:36.031188 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-487c2c83-ae68-4c4a-aa23-c6e406ebb065 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:36.032102 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-487c2c83-ae68-4c4a-aa23-c6e406ebb065 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:36.032735 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-487c2c83-ae68-4c4a-aa23-c6e406ebb065 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:36.033376 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-487c2c83-ae68-4c4a-aa23-c6e406ebb065 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:36.410210 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-487c2c83-ae68-4c4a-aa23-c6e406ebb065 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:36.421613 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-487c2c83-ae68-4c4a-aa23-c6e406ebb065 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:36.423612 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-487c2c83-ae68-4c4a-aa23-c6e406ebb065 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:36.425325 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-487c2c83-ae68-4c4a-aa23-c6e406ebb065 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.407210 Oct 04 08:56:36.450013 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 290/620] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:36 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:36.489706 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-62378454-d6ba-40a4-9128-9f0cfcfeb24d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:36.490661 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-62378454-d6ba-40a4-9128-9f0cfcfeb24d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:36.498976 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62378454-d6ba-40a4-9128-9f0cfcfeb24d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:36.499551 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62378454-d6ba-40a4-9128-9f0cfcfeb24d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:36.500014 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62378454-d6ba-40a4-9128-9f0cfcfeb24d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:36.500944 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62378454-d6ba-40a4-9128-9f0cfcfeb24d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:36.501400 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62378454-d6ba-40a4-9128-9f0cfcfeb24d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:36.501820 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-62378454-d6ba-40a4-9128-9f0cfcfeb24d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:36.722474 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-62378454-d6ba-40a4-9128-9f0cfcfeb24d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:36.732510 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-62378454-d6ba-40a4-9128-9f0cfcfeb24d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.248695 Oct 04 08:56:36.748524 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 331/621] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:36 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:36.934556 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-78698b25-4b89-4c88-a936-cef86cc97ceb req-df4f171c-085d-4dfe-99c7-dc276609eedf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c126bbd8-579f-48ce-88d5-29b61bd75c28", "tag": "aebd8c5b-67fa-48a2-be49-86c0fe14a590"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:36.962777 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-78698b25-4b89-4c88-a936-cef86cc97ceb req-df4f171c-085d-4dfe-99c7-dc276609eedf service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:36.965539 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-78698b25-4b89-4c88-a936-cef86cc97ceb req-df4f171c-085d-4dfe-99c7-dc276609eedf service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:36.966838 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-78698b25-4b89-4c88-a936-cef86cc97ceb req-df4f171c-085d-4dfe-99c7-dc276609eedf service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:36.983241 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-78698b25-4b89-4c88-a936-cef86cc97ceb req-df4f171c-085d-4dfe-99c7-dc276609eedf service nova] Creating event network-changed:aebd8c5b-67fa-48a2-be49-86c0fe14a590 for instance c126bbd8-579f-48ce-88d5-29b61bd75c28 on hv-cinder-84456 Oct 04 08:56:36.991752 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-78698b25-4b89-4c88-a936-cef86cc97ceb req-df4f171c-085d-4dfe-99c7-dc276609eedf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064320 Oct 04 08:56:36.996047 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 291/622] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:37.471302 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-359532b4-a6eb-4057-992e-a0444547676c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:37.472873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-359532b4-a6eb-4057-992e-a0444547676c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:37.540413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-359532b4-a6eb-4057-992e-a0444547676c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:37.542052 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-359532b4-a6eb-4057-992e-a0444547676c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:37.552353 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-359532b4-a6eb-4057-992e-a0444547676c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:37.559139 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-359532b4-a6eb-4057-992e-a0444547676c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:37.560525 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-359532b4-a6eb-4057-992e-a0444547676c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:37.561981 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-359532b4-a6eb-4057-992e-a0444547676c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:37.731262 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-359532b4-a6eb-4057-992e-a0444547676c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:37.742604 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-359532b4-a6eb-4057-992e-a0444547676c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:37.744083 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-359532b4-a6eb-4057-992e-a0444547676c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:37.745280 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-359532b4-a6eb-4057-992e-a0444547676c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.283236 Oct 04 08:56:37.745839 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 332/623] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:37 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:37.760599 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-dd6f86d5-422e-4d82-a82f-c4b58484e23c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:37.761606 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-dd6f86d5-422e-4d82-a82f-c4b58484e23c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:37.772358 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd6f86d5-422e-4d82-a82f-c4b58484e23c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:37.773249 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd6f86d5-422e-4d82-a82f-c4b58484e23c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:37.773782 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd6f86d5-422e-4d82-a82f-c4b58484e23c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:37.774902 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd6f86d5-422e-4d82-a82f-c4b58484e23c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:37.775425 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd6f86d5-422e-4d82-a82f-c4b58484e23c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:37.775954 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd6f86d5-422e-4d82-a82f-c4b58484e23c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:38.028363 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dd6f86d5-422e-4d82-a82f-c4b58484e23c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:38.043016 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-dd6f86d5-422e-4d82-a82f-c4b58484e23c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.290433 Oct 04 08:56:38.044224 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 292/624] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:37 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:38.774402 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f7306bf7-cebb-4aff-a6ac-d3655784c21f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:38.775211 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f7306bf7-cebb-4aff-a6ac-d3655784c21f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:38.781332 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f7306bf7-cebb-4aff-a6ac-d3655784c21f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:38.782111 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f7306bf7-cebb-4aff-a6ac-d3655784c21f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:38.782775 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f7306bf7-cebb-4aff-a6ac-d3655784c21f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:38.783697 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f7306bf7-cebb-4aff-a6ac-d3655784c21f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:38.784524 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f7306bf7-cebb-4aff-a6ac-d3655784c21f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:38.785080 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f7306bf7-cebb-4aff-a6ac-d3655784c21f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:38.959746 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f7306bf7-cebb-4aff-a6ac-d3655784c21f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:38.979427 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f7306bf7-cebb-4aff-a6ac-d3655784c21f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:38.980879 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f7306bf7-cebb-4aff-a6ac-d3655784c21f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:38.982064 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f7306bf7-cebb-4aff-a6ac-d3655784c21f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.212722 Oct 04 08:56:38.999939 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 333/625] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:38 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:39.082982 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4d50e011-fb7b-4197-848c-507fbe01b7c2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:39.083783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4d50e011-fb7b-4197-848c-507fbe01b7c2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:39.091171 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4d50e011-fb7b-4197-848c-507fbe01b7c2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:39.092264 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4d50e011-fb7b-4197-848c-507fbe01b7c2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:39.092927 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4d50e011-fb7b-4197-848c-507fbe01b7c2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:39.093836 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4d50e011-fb7b-4197-848c-507fbe01b7c2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:39.094520 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4d50e011-fb7b-4197-848c-507fbe01b7c2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:39.095193 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4d50e011-fb7b-4197-848c-507fbe01b7c2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:39.273420 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4d50e011-fb7b-4197-848c-507fbe01b7c2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:39.282924 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4d50e011-fb7b-4197-848c-507fbe01b7c2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.203912 Oct 04 08:56:39.288729 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 293/626] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:39 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:40.021608 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4cb47784-1942-4b6c-a320-34618de6a11e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:40.022168 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4cb47784-1942-4b6c-a320-34618de6a11e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:40.028456 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4cb47784-1942-4b6c-a320-34618de6a11e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:40.028932 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4cb47784-1942-4b6c-a320-34618de6a11e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:40.029380 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4cb47784-1942-4b6c-a320-34618de6a11e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:40.030054 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4cb47784-1942-4b6c-a320-34618de6a11e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:40.030491 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4cb47784-1942-4b6c-a320-34618de6a11e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:40.030907 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4cb47784-1942-4b6c-a320-34618de6a11e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:40.163512 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4cb47784-1942-4b6c-a320-34618de6a11e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:40.172260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4cb47784-1942-4b6c-a320-34618de6a11e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:40.173648 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4cb47784-1942-4b6c-a320-34618de6a11e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:40.174787 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4cb47784-1942-4b6c-a320-34618de6a11e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.157192 Oct 04 08:56:40.175380 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 334/627] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:40 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:40.308122 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c2ea80ea-1cfa-483f-82f4-54553403b208 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:40.309716 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c2ea80ea-1cfa-483f-82f4-54553403b208 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:40.317143 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c2ea80ea-1cfa-483f-82f4-54553403b208 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:40.317684 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c2ea80ea-1cfa-483f-82f4-54553403b208 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:40.318408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c2ea80ea-1cfa-483f-82f4-54553403b208 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:40.319232 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c2ea80ea-1cfa-483f-82f4-54553403b208 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:40.319730 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c2ea80ea-1cfa-483f-82f4-54553403b208 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:40.320197 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c2ea80ea-1cfa-483f-82f4-54553403b208 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:40.470718 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c2ea80ea-1cfa-483f-82f4-54553403b208 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:40.479003 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c2ea80ea-1cfa-483f-82f4-54553403b208 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.175789 Oct 04 08:56:40.479583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 294/628] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:40 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:41.200809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-db44f61a-335b-4bb7-8504-2e4ad1954f1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:41.201895 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-db44f61a-335b-4bb7-8504-2e4ad1954f1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:41.211713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-db44f61a-335b-4bb7-8504-2e4ad1954f1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.212285 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-db44f61a-335b-4bb7-8504-2e4ad1954f1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.212765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-db44f61a-335b-4bb7-8504-2e4ad1954f1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.213621 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-db44f61a-335b-4bb7-8504-2e4ad1954f1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.214218 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-db44f61a-335b-4bb7-8504-2e4ad1954f1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.214588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-db44f61a-335b-4bb7-8504-2e4ad1954f1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.394753 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-db44f61a-335b-4bb7-8504-2e4ad1954f1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:41.403663 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-db44f61a-335b-4bb7-8504-2e4ad1954f1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:41.405602 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-db44f61a-335b-4bb7-8504-2e4ad1954f1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:41.406790 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-db44f61a-335b-4bb7-8504-2e4ad1954f1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.210035 Oct 04 08:56:41.407387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 335/629] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:41 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:41.502526 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fc6a987e-2d1e-4531-9088-c364c53cdf5d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:41.503290 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-fc6a987e-2d1e-4531-9088-c364c53cdf5d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:41.510340 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc6a987e-2d1e-4531-9088-c364c53cdf5d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.510819 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc6a987e-2d1e-4531-9088-c364c53cdf5d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.511248 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc6a987e-2d1e-4531-9088-c364c53cdf5d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.511923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc6a987e-2d1e-4531-9088-c364c53cdf5d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.512402 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc6a987e-2d1e-4531-9088-c364c53cdf5d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.512826 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc6a987e-2d1e-4531-9088-c364c53cdf5d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.649925 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-fc6a987e-2d1e-4531-9088-c364c53cdf5d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:41.658145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fc6a987e-2d1e-4531-9088-c364c53cdf5d tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.159590 Oct 04 08:56:41.658686 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 295/630] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:41 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:42.431247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-996f792c-ee6a-431e-8fdd-0d2e5943ac42 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:42.443648 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-996f792c-ee6a-431e-8fdd-0d2e5943ac42 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:42.448255 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-996f792c-ee6a-431e-8fdd-0d2e5943ac42 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:42.448921 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-996f792c-ee6a-431e-8fdd-0d2e5943ac42 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:42.449588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-996f792c-ee6a-431e-8fdd-0d2e5943ac42 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:42.450325 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-996f792c-ee6a-431e-8fdd-0d2e5943ac42 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:42.450840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-996f792c-ee6a-431e-8fdd-0d2e5943ac42 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:42.451243 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-996f792c-ee6a-431e-8fdd-0d2e5943ac42 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:42.674392 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-996f792c-ee6a-431e-8fdd-0d2e5943ac42 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:42.684926 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0502fee5-9991-4ab3-b223-6582db0efcaa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:42.685516 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-996f792c-ee6a-431e-8fdd-0d2e5943ac42 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:42.686762 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0502fee5-9991-4ab3-b223-6582db0efcaa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:42.686978 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-996f792c-ee6a-431e-8fdd-0d2e5943ac42 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:42.688002 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-996f792c-ee6a-431e-8fdd-0d2e5943ac42 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.260762 Oct 04 08:56:42.689096 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 336/631] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:42 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:42.694191 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0502fee5-9991-4ab3-b223-6582db0efcaa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:42.694720 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0502fee5-9991-4ab3-b223-6582db0efcaa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:42.695161 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0502fee5-9991-4ab3-b223-6582db0efcaa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:42.695914 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0502fee5-9991-4ab3-b223-6582db0efcaa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:42.696374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0502fee5-9991-4ab3-b223-6582db0efcaa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:42.696797 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0502fee5-9991-4ab3-b223-6582db0efcaa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:42.869245 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0502fee5-9991-4ab3-b223-6582db0efcaa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:42.877465 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0502fee5-9991-4ab3-b223-6582db0efcaa tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.199701 Oct 04 08:56:42.884053 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 296/632] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:42 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:43.714599 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-06c3f0cc-974e-4362-a567-b0beaf5e1499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:43.715437 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-06c3f0cc-974e-4362-a567-b0beaf5e1499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:43.721973 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-06c3f0cc-974e-4362-a567-b0beaf5e1499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:43.722624 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-06c3f0cc-974e-4362-a567-b0beaf5e1499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:43.723052 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-06c3f0cc-974e-4362-a567-b0beaf5e1499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:43.723734 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-06c3f0cc-974e-4362-a567-b0beaf5e1499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:43.724213 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-06c3f0cc-974e-4362-a567-b0beaf5e1499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:43.724630 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-06c3f0cc-974e-4362-a567-b0beaf5e1499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:43.877917 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-06c3f0cc-974e-4362-a567-b0beaf5e1499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:43.886671 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-06c3f0cc-974e-4362-a567-b0beaf5e1499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:43.888362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-06c3f0cc-974e-4362-a567-b0beaf5e1499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:43.889496 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-06c3f0cc-974e-4362-a567-b0beaf5e1499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.179264 Oct 04 08:56:43.890063 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 337/633] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:43 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:43.901494 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f6f53b70-9f47-4c37-b798-d11522a74ad8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:43.902971 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f6f53b70-9f47-4c37-b798-d11522a74ad8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:43.910613 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6f53b70-9f47-4c37-b798-d11522a74ad8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:43.911310 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6f53b70-9f47-4c37-b798-d11522a74ad8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:43.911749 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6f53b70-9f47-4c37-b798-d11522a74ad8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:43.912478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6f53b70-9f47-4c37-b798-d11522a74ad8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:43.912964 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6f53b70-9f47-4c37-b798-d11522a74ad8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:43.913389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6f53b70-9f47-4c37-b798-d11522a74ad8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:44.065345 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f6f53b70-9f47-4c37-b798-d11522a74ad8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:44.073203 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f6f53b70-9f47-4c37-b798-d11522a74ad8 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.176709 Oct 04 08:56:44.073872 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 297/634] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:43 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:44.916911 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b74a31ac-4d47-4b7d-aade-6d8609148cf9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:44.917663 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b74a31ac-4d47-4b7d-aade-6d8609148cf9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:44.923777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b74a31ac-4d47-4b7d-aade-6d8609148cf9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:44.924473 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b74a31ac-4d47-4b7d-aade-6d8609148cf9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:44.925088 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b74a31ac-4d47-4b7d-aade-6d8609148cf9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:44.926199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b74a31ac-4d47-4b7d-aade-6d8609148cf9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:44.926539 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b74a31ac-4d47-4b7d-aade-6d8609148cf9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:44.927096 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b74a31ac-4d47-4b7d-aade-6d8609148cf9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.086071 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b74a31ac-4d47-4b7d-aade-6d8609148cf9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:45.095269 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b74a31ac-4d47-4b7d-aade-6d8609148cf9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:45.095816 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2858b020-45f7-44c7-9186-25b7c2698f81 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:45.096518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2858b020-45f7-44c7-9186-25b7c2698f81 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:45.097356 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b74a31ac-4d47-4b7d-aade-6d8609148cf9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:45.098558 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b74a31ac-4d47-4b7d-aade-6d8609148cf9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.187096 Oct 04 08:56:45.099117 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 338/635] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:44 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:45.103291 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2858b020-45f7-44c7-9186-25b7c2698f81 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.104409 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2858b020-45f7-44c7-9186-25b7c2698f81 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.105046 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2858b020-45f7-44c7-9186-25b7c2698f81 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.105189 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2858b020-45f7-44c7-9186-25b7c2698f81 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.105637 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2858b020-45f7-44c7-9186-25b7c2698f81 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.106986 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2858b020-45f7-44c7-9186-25b7c2698f81 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.243657 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2858b020-45f7-44c7-9186-25b7c2698f81 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:45.251362 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2858b020-45f7-44c7-9186-25b7c2698f81 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.159804 Oct 04 08:56:45.251940 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 298/636] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:45 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:46.274793 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4f7b5ccb-8325-451c-a533-bd768bcc5703 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:46.275516 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4f7b5ccb-8325-451c-a533-bd768bcc5703 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:46.282166 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4f7b5ccb-8325-451c-a533-bd768bcc5703 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.282651 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4f7b5ccb-8325-451c-a533-bd768bcc5703 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.283059 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4f7b5ccb-8325-451c-a533-bd768bcc5703 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.283778 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4f7b5ccb-8325-451c-a533-bd768bcc5703 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.284264 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4f7b5ccb-8325-451c-a533-bd768bcc5703 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.284671 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4f7b5ccb-8325-451c-a533-bd768bcc5703 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.301098 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-65fa208c-c097-4fbd-afcc-036bf76721c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:46.301747 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-65fa208c-c097-4fbd-afcc-036bf76721c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:46.308177 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65fa208c-c097-4fbd-afcc-036bf76721c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.308879 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65fa208c-c097-4fbd-afcc-036bf76721c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.309468 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65fa208c-c097-4fbd-afcc-036bf76721c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.310345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65fa208c-c097-4fbd-afcc-036bf76721c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.310947 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65fa208c-c097-4fbd-afcc-036bf76721c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.311538 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65fa208c-c097-4fbd-afcc-036bf76721c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.530235 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-65fa208c-c097-4fbd-afcc-036bf76721c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:46.535293 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4f7b5ccb-8325-451c-a533-bd768bcc5703 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:46.541032 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-65fa208c-c097-4fbd-afcc-036bf76721c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:46.542930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-65fa208c-c097-4fbd-afcc-036bf76721c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:46.544062 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4f7b5ccb-8325-451c-a533-bd768bcc5703 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.273226 Oct 04 08:56:46.544415 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-65fa208c-c097-4fbd-afcc-036bf76721c2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.423275 Oct 04 08:56:46.545043 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 339/637] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:46 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:56:46.559644 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 299/638] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:46 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:47.573620 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2bb0cdd2-a31a-481c-aafc-c50d4ed008ba tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:47.574318 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5be6d8ee-645a-4b78-81c5-2a7c5c7e2499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:47.574720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5be6d8ee-645a-4b78-81c5-2a7c5c7e2499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:47.575867 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2bb0cdd2-a31a-481c-aafc-c50d4ed008ba tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:47.580549 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:47.584673 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2bb0cdd2-a31a-481c-aafc-c50d4ed008ba tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.585366 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5be6d8ee-645a-4b78-81c5-2a7c5c7e2499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.585863 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5be6d8ee-645a-4b78-81c5-2a7c5c7e2499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.586225 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2bb0cdd2-a31a-481c-aafc-c50d4ed008ba tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.586891 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2bb0cdd2-a31a-481c-aafc-c50d4ed008ba tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.588159 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2bb0cdd2-a31a-481c-aafc-c50d4ed008ba tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.588425 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5be6d8ee-645a-4b78-81c5-2a7c5c7e2499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.589038 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5be6d8ee-645a-4b78-81c5-2a7c5c7e2499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.589327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2bb0cdd2-a31a-481c-aafc-c50d4ed008ba tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.589486 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5be6d8ee-645a-4b78-81c5-2a7c5c7e2499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.590031 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2bb0cdd2-a31a-481c-aafc-c50d4ed008ba tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.591927 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5be6d8ee-645a-4b78-81c5-2a7c5c7e2499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.827811 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2bb0cdd2-a31a-481c-aafc-c50d4ed008ba tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:47.834763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5be6d8ee-645a-4b78-81c5-2a7c5c7e2499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:47.835691 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2bb0cdd2-a31a-481c-aafc-c50d4ed008ba tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.266133 Oct 04 08:56:47.836309 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 300/639] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:47 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:47.843792 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5be6d8ee-645a-4b78-81c5-2a7c5c7e2499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:47.845239 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5be6d8ee-645a-4b78-81c5-2a7c5c7e2499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:47.846389 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5be6d8ee-645a-4b78-81c5-2a7c5c7e2499 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.276911 Oct 04 08:56:47.846938 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 340/640] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:47 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:48.858262 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9f629ccc-6443-4450-aeba-79c82b8530e2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:48.861080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9f629ccc-6443-4450-aeba-79c82b8530e2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:48.868988 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9f629ccc-6443-4450-aeba-79c82b8530e2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:48.869458 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9f629ccc-6443-4450-aeba-79c82b8530e2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:48.869930 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9f629ccc-6443-4450-aeba-79c82b8530e2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:48.870636 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9f629ccc-6443-4450-aeba-79c82b8530e2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:48.871086 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9f629ccc-6443-4450-aeba-79c82b8530e2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:48.871612 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9f629ccc-6443-4450-aeba-79c82b8530e2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:48.878298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7bef89bd-e811-4d5b-a37c-6fcee4be5729 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:48.878896 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7bef89bd-e811-4d5b-a37c-6fcee4be5729 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:48.885252 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7bef89bd-e811-4d5b-a37c-6fcee4be5729 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:48.885739 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7bef89bd-e811-4d5b-a37c-6fcee4be5729 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:48.886163 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7bef89bd-e811-4d5b-a37c-6fcee4be5729 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:48.886855 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7bef89bd-e811-4d5b-a37c-6fcee4be5729 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:48.887469 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7bef89bd-e811-4d5b-a37c-6fcee4be5729 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:48.887937 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7bef89bd-e811-4d5b-a37c-6fcee4be5729 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:49.068909 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9f629ccc-6443-4450-aeba-79c82b8530e2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:49.071809 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=100 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:49.079401 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9f629ccc-6443-4450-aeba-79c82b8530e2 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.225069 Oct 04 08:56:49.080017 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 301/641] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:48 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:49.085074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7bef89bd-e811-4d5b-a37c-6fcee4be5729 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:49.093773 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7bef89bd-e811-4d5b-a37c-6fcee4be5729 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:49.095195 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7bef89bd-e811-4d5b-a37c-6fcee4be5729 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:49.096378 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7bef89bd-e811-4d5b-a37c-6fcee4be5729 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.221914 Oct 04 08:56:49.096918 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 341/642] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:48 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:50.102718 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-75f92ac3-2363-4cb3-81e1-65aa1507bc47 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:50.103362 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-75f92ac3-2363-4cb3-81e1-65aa1507bc47 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:50.110389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-75f92ac3-2363-4cb3-81e1-65aa1507bc47 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:50.110880 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-75f92ac3-2363-4cb3-81e1-65aa1507bc47 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:50.111319 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-75f92ac3-2363-4cb3-81e1-65aa1507bc47 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:50.112055 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-75f92ac3-2363-4cb3-81e1-65aa1507bc47 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:50.112513 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-75f92ac3-2363-4cb3-81e1-65aa1507bc47 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:50.112940 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-75f92ac3-2363-4cb3-81e1-65aa1507bc47 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:50.128780 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-55386b82-8d9b-49c6-9568-d18196adf741 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:50.129332 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-55386b82-8d9b-49c6-9568-d18196adf741 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:50.135520 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-55386b82-8d9b-49c6-9568-d18196adf741 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:50.136043 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-55386b82-8d9b-49c6-9568-d18196adf741 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:50.136480 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-55386b82-8d9b-49c6-9568-d18196adf741 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:50.137174 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-55386b82-8d9b-49c6-9568-d18196adf741 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:50.137620 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-55386b82-8d9b-49c6-9568-d18196adf741 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:50.138035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-55386b82-8d9b-49c6-9568-d18196adf741 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:50.320729 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-75f92ac3-2363-4cb3-81e1-65aa1507bc47 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:50.324896 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-55386b82-8d9b-49c6-9568-d18196adf741 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:50.328884 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-75f92ac3-2363-4cb3-81e1-65aa1507bc47 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.230164 Oct 04 08:56:50.329691 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 302/643] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:50 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:50.334694 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-55386b82-8d9b-49c6-9568-d18196adf741 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:50.336199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-55386b82-8d9b-49c6-9568-d18196adf741 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:50.337397 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-55386b82-8d9b-49c6-9568-d18196adf741 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.212540 Oct 04 08:56:50.337950 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 342/644] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:50 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:51.354203 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c17dfcbb-9d91-44ac-bcae-a1a309f99da9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:51.354804 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c17dfcbb-9d91-44ac-bcae-a1a309f99da9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:51.365740 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-077bbbfb-5a71-4598-bf04-a0f749f86d81 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:51.366567 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-077bbbfb-5a71-4598-bf04-a0f749f86d81 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:51.367506 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c17dfcbb-9d91-44ac-bcae-a1a309f99da9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:51.370627 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c17dfcbb-9d91-44ac-bcae-a1a309f99da9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:51.371196 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c17dfcbb-9d91-44ac-bcae-a1a309f99da9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:51.372002 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c17dfcbb-9d91-44ac-bcae-a1a309f99da9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:51.372689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c17dfcbb-9d91-44ac-bcae-a1a309f99da9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:51.373286 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-077bbbfb-5a71-4598-bf04-a0f749f86d81 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:51.374009 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-077bbbfb-5a71-4598-bf04-a0f749f86d81 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:51.374656 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-077bbbfb-5a71-4598-bf04-a0f749f86d81 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:51.375357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c17dfcbb-9d91-44ac-bcae-a1a309f99da9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:51.375810 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-077bbbfb-5a71-4598-bf04-a0f749f86d81 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:51.376499 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-077bbbfb-5a71-4598-bf04-a0f749f86d81 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:51.377137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-077bbbfb-5a71-4598-bf04-a0f749f86d81 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:51.573811 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-077bbbfb-5a71-4598-bf04-a0f749f86d81 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:51.578011 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c17dfcbb-9d91-44ac-bcae-a1a309f99da9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:51.584029 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-077bbbfb-5a71-4598-bf04-a0f749f86d81 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:51.585487 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-077bbbfb-5a71-4598-bf04-a0f749f86d81 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:51.585897 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c17dfcbb-9d91-44ac-bcae-a1a309f99da9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.236491 Oct 04 08:56:51.586570 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 303/645] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:51 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:51.586844 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-077bbbfb-5a71-4598-bf04-a0f749f86d81 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.225698 Oct 04 08:56:51.587416 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 343/646] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:51 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:52.615120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-dcf15cd2-3d2b-488c-bbd6-64c0113b430c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:52.616276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-dcf15cd2-3d2b-488c-bbd6-64c0113b430c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:52.616950 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6187b8c8-b3fb-40b2-ae8f-d2a32d284486 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:52.617894 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6187b8c8-b3fb-40b2-ae8f-d2a32d284486 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:52.626742 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dcf15cd2-3d2b-488c-bbd6-64c0113b430c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:52.627505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dcf15cd2-3d2b-488c-bbd6-64c0113b430c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:52.628177 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6187b8c8-b3fb-40b2-ae8f-d2a32d284486 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:52.628445 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dcf15cd2-3d2b-488c-bbd6-64c0113b430c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:52.628979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6187b8c8-b3fb-40b2-ae8f-d2a32d284486 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:52.629448 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dcf15cd2-3d2b-488c-bbd6-64c0113b430c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:52.629683 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6187b8c8-b3fb-40b2-ae8f-d2a32d284486 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:52.630399 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dcf15cd2-3d2b-488c-bbd6-64c0113b430c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:52.630864 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6187b8c8-b3fb-40b2-ae8f-d2a32d284486 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:52.631127 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dcf15cd2-3d2b-488c-bbd6-64c0113b430c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:52.631668 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6187b8c8-b3fb-40b2-ae8f-d2a32d284486 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:52.632504 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6187b8c8-b3fb-40b2-ae8f-d2a32d284486 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:52.637870 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=100 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:52.833674 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6187b8c8-b3fb-40b2-ae8f-d2a32d284486 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:52.837048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dcf15cd2-3d2b-488c-bbd6-64c0113b430c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:52.842565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6187b8c8-b3fb-40b2-ae8f-d2a32d284486 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:52.843973 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6187b8c8-b3fb-40b2-ae8f-d2a32d284486 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:52.845004 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-dcf15cd2-3d2b-488c-bbd6-64c0113b430c tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.237960 Oct 04 08:56:52.845141 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6187b8c8-b3fb-40b2-ae8f-d2a32d284486 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.235203 Oct 04 08:56:52.845579 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 304/647] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:52 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:52.845816 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 344/648] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:52 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:53.871079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a2dd93bf-a61d-4a43-8dc3-bd1e7e59d6fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:53.871674 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-816847e2-f601-47e7-ab4a-39c6087028a9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:53.872052 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a2dd93bf-a61d-4a43-8dc3-bd1e7e59d6fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:53.872143 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-816847e2-f601-47e7-ab4a-39c6087028a9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:53.878156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-816847e2-f601-47e7-ab4a-39c6087028a9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:53.878531 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a2dd93bf-a61d-4a43-8dc3-bd1e7e59d6fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:53.878684 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-816847e2-f601-47e7-ab4a-39c6087028a9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:53.879054 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-816847e2-f601-47e7-ab4a-39c6087028a9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:53.879204 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a2dd93bf-a61d-4a43-8dc3-bd1e7e59d6fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:53.879579 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a2dd93bf-a61d-4a43-8dc3-bd1e7e59d6fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:53.879729 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-816847e2-f601-47e7-ab4a-39c6087028a9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:53.880223 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-816847e2-f601-47e7-ab4a-39c6087028a9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:53.880383 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a2dd93bf-a61d-4a43-8dc3-bd1e7e59d6fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:53.880645 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-816847e2-f601-47e7-ab4a-39c6087028a9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:53.880785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a2dd93bf-a61d-4a43-8dc3-bd1e7e59d6fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:53.881171 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a2dd93bf-a61d-4a43-8dc3-bd1e7e59d6fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:54.071866 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-816847e2-f601-47e7-ab4a-39c6087028a9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:54.075374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a2dd93bf-a61d-4a43-8dc3-bd1e7e59d6fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:54.080327 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-816847e2-f601-47e7-ab4a-39c6087028a9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1318 microversion: 2.1 time: 0.213084 Oct 04 08:56:54.081077 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 345/649] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:53 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:54.084866 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a2dd93bf-a61d-4a43-8dc3-bd1e7e59d6fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:54.086651 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a2dd93bf-a61d-4a43-8dc3-bd1e7e59d6fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:54.088025 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a2dd93bf-a61d-4a43-8dc3-bd1e7e59d6fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.220791 Oct 04 08:56:54.088596 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 305/650] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:53 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:55.106675 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e021b7ac-bfc4-4eb6-b67d-8312d321f188 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:55.107280 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e021b7ac-bfc4-4eb6-b67d-8312d321f188 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:55.113147 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-956fb42b-1d6a-479c-a7f0-329d57a2fe9c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:55.113654 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e021b7ac-bfc4-4eb6-b67d-8312d321f188 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:55.113764 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-956fb42b-1d6a-479c-a7f0-329d57a2fe9c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:55.114509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e021b7ac-bfc4-4eb6-b67d-8312d321f188 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:55.114945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e021b7ac-bfc4-4eb6-b67d-8312d321f188 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:55.115649 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e021b7ac-bfc4-4eb6-b67d-8312d321f188 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:55.116138 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e021b7ac-bfc4-4eb6-b67d-8312d321f188 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:55.116563 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e021b7ac-bfc4-4eb6-b67d-8312d321f188 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:55.122105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-956fb42b-1d6a-479c-a7f0-329d57a2fe9c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:55.122932 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-956fb42b-1d6a-479c-a7f0-329d57a2fe9c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:55.123681 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-956fb42b-1d6a-479c-a7f0-329d57a2fe9c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:55.124914 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-956fb42b-1d6a-479c-a7f0-329d57a2fe9c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:55.125698 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-956fb42b-1d6a-479c-a7f0-329d57a2fe9c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:55.126417 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-956fb42b-1d6a-479c-a7f0-329d57a2fe9c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:55.348889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-956fb42b-1d6a-479c-a7f0-329d57a2fe9c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:55.356669 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e021b7ac-bfc4-4eb6-b67d-8312d321f188 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:55.359183 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-956fb42b-1d6a-479c-a7f0-329d57a2fe9c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:55.360667 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-956fb42b-1d6a-479c-a7f0-329d57a2fe9c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:55.361813 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-956fb42b-1d6a-479c-a7f0-329d57a2fe9c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.252599 Oct 04 08:56:55.362371 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 306/651] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:55 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:55.365953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e021b7ac-bfc4-4eb6-b67d-8312d321f188 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1506 microversion: 2.1 time: 0.264812 Oct 04 08:56:55.366683 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 346/652] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:55 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:55.389805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5833efac-bd49-4e7d-84bc-3ff77eec6217 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43f37399-e9fe-49b7-8870-74348ea810ac", "device": "/dev/sdb"}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:55.392385 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5833efac-bd49-4e7d-84bc-3ff77eec6217 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:55.398463 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5833efac-bd49-4e7d-84bc-3ff77eec6217 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:55.398951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5833efac-bd49-4e7d-84bc-3ff77eec6217 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:55.399385 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5833efac-bd49-4e7d-84bc-3ff77eec6217 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:55.400128 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5833efac-bd49-4e7d-84bc-3ff77eec6217 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:55.400583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5833efac-bd49-4e7d-84bc-3ff77eec6217 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:55.401007 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5833efac-bd49-4e7d-84bc-3ff77eec6217 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.389340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-03f3d2dc-978c-4f6c-8749-455227ba95cf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:56.390084 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-03f3d2dc-978c-4f6c-8749-455227ba95cf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:56.398386 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-03f3d2dc-978c-4f6c-8749-455227ba95cf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.398974 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-03f3d2dc-978c-4f6c-8749-455227ba95cf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.399625 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-03f3d2dc-978c-4f6c-8749-455227ba95cf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.400582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-03f3d2dc-978c-4f6c-8749-455227ba95cf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.401159 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-03f3d2dc-978c-4f6c-8749-455227ba95cf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.401747 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-03f3d2dc-978c-4f6c-8749-455227ba95cf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.536164 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-03f3d2dc-978c-4f6c-8749-455227ba95cf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:56.544934 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-03f3d2dc-978c-4f6c-8749-455227ba95cf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:56.546294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-03f3d2dc-978c-4f6c-8749-455227ba95cf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:56.547448 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-03f3d2dc-978c-4f6c-8749-455227ba95cf tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.163190 Oct 04 08:56:56.548030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 347/653] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:56 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:57.573105 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1cd31e5a-2278-4c06-9016-e39ddc681a05 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:57.573847 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1cd31e5a-2278-4c06-9016-e39ddc681a05 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:57.584655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1cd31e5a-2278-4c06-9016-e39ddc681a05 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:57.585251 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1cd31e5a-2278-4c06-9016-e39ddc681a05 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:57.585768 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1cd31e5a-2278-4c06-9016-e39ddc681a05 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:57.586561 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1cd31e5a-2278-4c06-9016-e39ddc681a05 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:57.589854 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1cd31e5a-2278-4c06-9016-e39ddc681a05 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:57.590204 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1cd31e5a-2278-4c06-9016-e39ddc681a05 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:57.635100 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5833efac-bd49-4e7d-84bc-3ff77eec6217 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "POST /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.249158 Oct 04 08:56:57.643297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 307/654] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Oct 4 08:56:55 2022] POST /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e/os-volume_attachments => generated 194 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:57.825379 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1cd31e5a-2278-4c06-9016-e39ddc681a05 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:57.840909 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1cd31e5a-2278-4c06-9016-e39ddc681a05 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:57.842380 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1cd31e5a-2278-4c06-9016-e39ddc681a05 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:57.844663 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1cd31e5a-2278-4c06-9016-e39ddc681a05 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.275715 Oct 04 08:56:57.848556 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 348/655] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:57 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:58.874906 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9ed7b033-6b04-4286-bd28-0fc5a5fd4f6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:58.875506 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9ed7b033-6b04-4286-bd28-0fc5a5fd4f6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:58.877549 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=58 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:58.882914 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ed7b033-6b04-4286-bd28-0fc5a5fd4f6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:58.883371 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ed7b033-6b04-4286-bd28-0fc5a5fd4f6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:58.883805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ed7b033-6b04-4286-bd28-0fc5a5fd4f6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:58.884666 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ed7b033-6b04-4286-bd28-0fc5a5fd4f6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:58.885115 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ed7b033-6b04-4286-bd28-0fc5a5fd4f6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:58.885809 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ed7b033-6b04-4286-bd28-0fc5a5fd4f6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:59.023548 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9ed7b033-6b04-4286-bd28-0fc5a5fd4f6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:59.032378 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9ed7b033-6b04-4286-bd28-0fc5a5fd4f6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:59.033812 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9ed7b033-6b04-4286-bd28-0fc5a5fd4f6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:59.035059 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9ed7b033-6b04-4286-bd28-0fc5a5fd4f6a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.165180 Oct 04 08:56:59.035605 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 308/656] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:58 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:00.064999 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9ab43755-1717-490a-b429-5df8696c7482 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:00.065823 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9ab43755-1717-490a-b429-5df8696c7482 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:00.075106 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9ab43755-1717-490a-b429-5df8696c7482 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:00.075585 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9ab43755-1717-490a-b429-5df8696c7482 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:00.076042 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9ab43755-1717-490a-b429-5df8696c7482 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:00.076724 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9ab43755-1717-490a-b429-5df8696c7482 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:00.077168 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9ab43755-1717-490a-b429-5df8696c7482 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:00.077583 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9ab43755-1717-490a-b429-5df8696c7482 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:00.216505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9ab43755-1717-490a-b429-5df8696c7482 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:00.225998 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9ab43755-1717-490a-b429-5df8696c7482 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:00.227475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9ab43755-1717-490a-b429-5df8696c7482 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:00.228868 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-9ab43755-1717-490a-b429-5df8696c7482 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.170553 Oct 04 08:57:00.229421 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 349/657] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:00 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:01.266926 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-786a0736-d897-4bf4-b4a1-47d22d375698 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:01.267697 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-786a0736-d897-4bf4-b4a1-47d22d375698 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:01.277188 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-786a0736-d897-4bf4-b4a1-47d22d375698 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:01.277662 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-786a0736-d897-4bf4-b4a1-47d22d375698 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:01.278157 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-786a0736-d897-4bf4-b4a1-47d22d375698 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:01.278835 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-786a0736-d897-4bf4-b4a1-47d22d375698 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:01.279280 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-786a0736-d897-4bf4-b4a1-47d22d375698 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:01.279721 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-786a0736-d897-4bf4-b4a1-47d22d375698 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:01.417064 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-786a0736-d897-4bf4-b4a1-47d22d375698 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:01.426164 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-786a0736-d897-4bf4-b4a1-47d22d375698 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:01.427609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-786a0736-d897-4bf4-b4a1-47d22d375698 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:01.428794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-786a0736-d897-4bf4-b4a1-47d22d375698 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.167597 Oct 04 08:57:01.429344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 309/658] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:01 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:02.458349 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0c927628-9bc4-4583-8472-686e77806851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:02.459313 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0c927628-9bc4-4583-8472-686e77806851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:02.469565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0c927628-9bc4-4583-8472-686e77806851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:02.470351 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0c927628-9bc4-4583-8472-686e77806851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:02.471062 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0c927628-9bc4-4583-8472-686e77806851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:02.472282 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0c927628-9bc4-4583-8472-686e77806851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:02.473031 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0c927628-9bc4-4583-8472-686e77806851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:02.473725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0c927628-9bc4-4583-8472-686e77806851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:02.607614 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0c927628-9bc4-4583-8472-686e77806851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:02.617113 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0c927628-9bc4-4583-8472-686e77806851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:02.618542 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0c927628-9bc4-4583-8472-686e77806851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:02.619699 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0c927628-9bc4-4583-8472-686e77806851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.167898 Oct 04 08:57:02.620284 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 350/659] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:02 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:03.577905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a4ed4281-cdbe-4881-8fb9-57a54c80dfbe tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:03.578681 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a4ed4281-cdbe-4881-8fb9-57a54c80dfbe tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:03.589567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a4ed4281-cdbe-4881-8fb9-57a54c80dfbe tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:03.590051 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a4ed4281-cdbe-4881-8fb9-57a54c80dfbe tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:03.590485 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a4ed4281-cdbe-4881-8fb9-57a54c80dfbe tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:03.591201 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a4ed4281-cdbe-4881-8fb9-57a54c80dfbe tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:03.591651 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a4ed4281-cdbe-4881-8fb9-57a54c80dfbe tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:03.592179 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a4ed4281-cdbe-4881-8fb9-57a54c80dfbe tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:03.619197 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a4ed4281-cdbe-4881-8fb9-57a54c80dfbe tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/ips" status: 200 len: 145 microversion: 2.1 time: 0.047541 Oct 04 08:57:03.620066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 310/660] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Oct 4 08:57:03 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/ips => generated 145 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:03.646408 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ab4fda5a-c8ec-4042-9781-3978ec99a807 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:03.647448 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ab4fda5a-c8ec-4042-9781-3978ec99a807 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:03.655227 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ab4fda5a-c8ec-4042-9781-3978ec99a807 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:03.655701 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ab4fda5a-c8ec-4042-9781-3978ec99a807 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:03.656153 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ab4fda5a-c8ec-4042-9781-3978ec99a807 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:03.656843 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ab4fda5a-c8ec-4042-9781-3978ec99a807 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:03.657288 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ab4fda5a-c8ec-4042-9781-3978ec99a807 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:03.657712 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ab4fda5a-c8ec-4042-9781-3978ec99a807 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:03.798084 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ab4fda5a-c8ec-4042-9781-3978ec99a807 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:03.810632 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ab4fda5a-c8ec-4042-9781-3978ec99a807 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:03.812862 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ab4fda5a-c8ec-4042-9781-3978ec99a807 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:03.814834 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ab4fda5a-c8ec-4042-9781-3978ec99a807 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.172068 Oct 04 08:57:03.815751 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 351/661] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:03 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:04.846989 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5687dd64-1a66-4fcf-a883-7cec9ef0691a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:04.847984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5687dd64-1a66-4fcf-a883-7cec9ef0691a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:04.857544 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5687dd64-1a66-4fcf-a883-7cec9ef0691a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:04.858028 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5687dd64-1a66-4fcf-a883-7cec9ef0691a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:04.858459 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5687dd64-1a66-4fcf-a883-7cec9ef0691a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:04.859148 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5687dd64-1a66-4fcf-a883-7cec9ef0691a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:04.859597 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5687dd64-1a66-4fcf-a883-7cec9ef0691a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:04.860049 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5687dd64-1a66-4fcf-a883-7cec9ef0691a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:04.995911 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5687dd64-1a66-4fcf-a883-7cec9ef0691a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:05.004785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5687dd64-1a66-4fcf-a883-7cec9ef0691a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:05.006219 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5687dd64-1a66-4fcf-a883-7cec9ef0691a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:05.007375 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5687dd64-1a66-4fcf-a883-7cec9ef0691a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.167160 Oct 04 08:57:05.007971 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 311/662] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:04 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:06.033098 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-955866ca-e9a3-4623-8a10-8c55a59d9600 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:06.033701 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-955866ca-e9a3-4623-8a10-8c55a59d9600 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:06.040069 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-955866ca-e9a3-4623-8a10-8c55a59d9600 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:06.040545 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-955866ca-e9a3-4623-8a10-8c55a59d9600 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:06.040969 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-955866ca-e9a3-4623-8a10-8c55a59d9600 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:06.041653 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-955866ca-e9a3-4623-8a10-8c55a59d9600 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:06.042136 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-955866ca-e9a3-4623-8a10-8c55a59d9600 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:06.042557 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-955866ca-e9a3-4623-8a10-8c55a59d9600 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:06.182717 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-955866ca-e9a3-4623-8a10-8c55a59d9600 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:06.193624 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-955866ca-e9a3-4623-8a10-8c55a59d9600 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:06.195077 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-955866ca-e9a3-4623-8a10-8c55a59d9600 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:06.196259 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-955866ca-e9a3-4623-8a10-8c55a59d9600 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.167213 Oct 04 08:57:06.197004 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 352/663] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:06 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:07.224067 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b3b96977-f6b6-442b-8240-1ec882568021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:07.224729 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b3b96977-f6b6-442b-8240-1ec882568021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:07.234925 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b3b96977-f6b6-442b-8240-1ec882568021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:07.235503 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b3b96977-f6b6-442b-8240-1ec882568021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:07.236598 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b3b96977-f6b6-442b-8240-1ec882568021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:07.237605 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b3b96977-f6b6-442b-8240-1ec882568021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:07.238216 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b3b96977-f6b6-442b-8240-1ec882568021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:07.238823 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b3b96977-f6b6-442b-8240-1ec882568021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:07.382383 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b3b96977-f6b6-442b-8240-1ec882568021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:07.391106 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b3b96977-f6b6-442b-8240-1ec882568021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:07.392592 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b3b96977-f6b6-442b-8240-1ec882568021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:07.393779 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b3b96977-f6b6-442b-8240-1ec882568021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.175349 Oct 04 08:57:07.394417 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 312/664] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:07 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:08.424290 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-34b1e0ad-8550-4c6b-86c1-65edca13f4fe tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:08.425182 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-34b1e0ad-8550-4c6b-86c1-65edca13f4fe tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:08.434413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-34b1e0ad-8550-4c6b-86c1-65edca13f4fe tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:08.435153 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-34b1e0ad-8550-4c6b-86c1-65edca13f4fe tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:08.435812 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-34b1e0ad-8550-4c6b-86c1-65edca13f4fe tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:08.436947 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-34b1e0ad-8550-4c6b-86c1-65edca13f4fe tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:08.437649 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-34b1e0ad-8550-4c6b-86c1-65edca13f4fe tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:08.438425 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-34b1e0ad-8550-4c6b-86c1-65edca13f4fe tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:08.570342 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-34b1e0ad-8550-4c6b-86c1-65edca13f4fe tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:08.579335 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-34b1e0ad-8550-4c6b-86c1-65edca13f4fe tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:08.581779 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-34b1e0ad-8550-4c6b-86c1-65edca13f4fe tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:08.582956 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-34b1e0ad-8550-4c6b-86c1-65edca13f4fe tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.164672 Oct 04 08:57:08.583483 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 353/665] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:08 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:09.238278 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ba9e619a-f991-446c-96ca-c0587c27f411 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a65c23bf-b508-433f-b91b-b325f8e5ba52"}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:09.241156 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ba9e619a-f991-446c-96ca-c0587c27f411 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:09.247921 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ba9e619a-f991-446c-96ca-c0587c27f411 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:09.248413 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ba9e619a-f991-446c-96ca-c0587c27f411 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:09.248843 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ba9e619a-f991-446c-96ca-c0587c27f411 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:09.249527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ba9e619a-f991-446c-96ca-c0587c27f411 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:09.250088 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ba9e619a-f991-446c-96ca-c0587c27f411 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:09.250519 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ba9e619a-f991-446c-96ca-c0587c27f411 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:09.571472 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ba9e619a-f991-446c-96ca-c0587c27f411 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "POST /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337054 Oct 04 08:57:09.572118 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 313/666] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Oct 4 08:57:09 2022] POST /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:09.609284 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e250bfcc-8ba0-4b0e-92e4-e7a3a4e89021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:09.609890 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e250bfcc-8ba0-4b0e-92e4-e7a3a4e89021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:09.621764 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e250bfcc-8ba0-4b0e-92e4-e7a3a4e89021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:09.622254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e250bfcc-8ba0-4b0e-92e4-e7a3a4e89021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:09.622677 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e250bfcc-8ba0-4b0e-92e4-e7a3a4e89021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:09.623397 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e250bfcc-8ba0-4b0e-92e4-e7a3a4e89021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:09.623837 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e250bfcc-8ba0-4b0e-92e4-e7a3a4e89021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:09.624289 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e250bfcc-8ba0-4b0e-92e4-e7a3a4e89021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:09.754234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e250bfcc-8ba0-4b0e-92e4-e7a3a4e89021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:09.762974 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e250bfcc-8ba0-4b0e-92e4-e7a3a4e89021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:09.764435 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e250bfcc-8ba0-4b0e-92e4-e7a3a4e89021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:09.765576 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e250bfcc-8ba0-4b0e-92e4-e7a3a4e89021 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.160294 Oct 04 08:57:09.766138 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 354/667] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:09 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:10.798377 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e3b951c5-a03f-4984-bb51-744aba276479 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:10.799177 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e3b951c5-a03f-4984-bb51-744aba276479 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:10.807943 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e3b951c5-a03f-4984-bb51-744aba276479 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:10.808562 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e3b951c5-a03f-4984-bb51-744aba276479 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:10.809004 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e3b951c5-a03f-4984-bb51-744aba276479 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:10.809860 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e3b951c5-a03f-4984-bb51-744aba276479 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:10.810456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e3b951c5-a03f-4984-bb51-744aba276479 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:10.811068 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e3b951c5-a03f-4984-bb51-744aba276479 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:10.963209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e3b951c5-a03f-4984-bb51-744aba276479 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:10.973642 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e3b951c5-a03f-4984-bb51-744aba276479 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:10.975168 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e3b951c5-a03f-4984-bb51-744aba276479 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:10.976380 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e3b951c5-a03f-4984-bb51-744aba276479 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.188478 Oct 04 08:57:10.976935 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 314/668] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:10 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:12.002498 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2b0efeec-8587-425d-94d9-84b9618b93b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:12.003011 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2b0efeec-8587-425d-94d9-84b9618b93b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:12.010048 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2b0efeec-8587-425d-94d9-84b9618b93b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:12.010525 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2b0efeec-8587-425d-94d9-84b9618b93b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:12.010948 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2b0efeec-8587-425d-94d9-84b9618b93b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:12.011632 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2b0efeec-8587-425d-94d9-84b9618b93b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:12.012119 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2b0efeec-8587-425d-94d9-84b9618b93b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:12.012531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2b0efeec-8587-425d-94d9-84b9618b93b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:12.149892 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2b0efeec-8587-425d-94d9-84b9618b93b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:12.158941 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2b0efeec-8587-425d-94d9-84b9618b93b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:12.160390 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2b0efeec-8587-425d-94d9-84b9618b93b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:12.161540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2b0efeec-8587-425d-94d9-84b9618b93b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.163109 Oct 04 08:57:12.162065 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 355/669] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:11 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:13.015567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-2fa622e9-83b9-4bf0-90e3-339f9e74c1d0 req-45a386a0-230b-4b1f-808f-bb8702cf5eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4454abc-67a9-470b-bdce-5a69bc51bbed", "name": "network-vif-plugged", "status": "completed", "tag": "a52bd48f-906c-4b87-b387-01e1bfaa69c2"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:13.028773 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-2fa622e9-83b9-4bf0-90e3-339f9e74c1d0 req-45a386a0-230b-4b1f-808f-bb8702cf5eeb service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:13.029699 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-2fa622e9-83b9-4bf0-90e3-339f9e74c1d0 req-45a386a0-230b-4b1f-808f-bb8702cf5eeb service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:13.030134 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-2fa622e9-83b9-4bf0-90e3-339f9e74c1d0 req-45a386a0-230b-4b1f-808f-bb8702cf5eeb service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:13.041533 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-2fa622e9-83b9-4bf0-90e3-339f9e74c1d0 req-45a386a0-230b-4b1f-808f-bb8702cf5eeb service nova] Creating event network-vif-plugged:a52bd48f-906c-4b87-b387-01e1bfaa69c2 for instance f4454abc-67a9-470b-bdce-5a69bc51bbed on hv-cinder-84456 Oct 04 08:57:13.046678 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-2fa622e9-83b9-4bf0-90e3-339f9e74c1d0 req-45a386a0-230b-4b1f-808f-bb8702cf5eeb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037883 Oct 04 08:57:13.047511 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 315/670] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:13.191073 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-616e7c67-a075-4eec-af79-44cb4fec56e8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:13.191928 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-616e7c67-a075-4eec-af79-44cb4fec56e8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:13.201810 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-616e7c67-a075-4eec-af79-44cb4fec56e8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:13.202283 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-616e7c67-a075-4eec-af79-44cb4fec56e8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:13.202705 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-616e7c67-a075-4eec-af79-44cb4fec56e8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:13.203382 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-616e7c67-a075-4eec-af79-44cb4fec56e8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:13.203829 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-616e7c67-a075-4eec-af79-44cb4fec56e8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:13.204275 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-616e7c67-a075-4eec-af79-44cb4fec56e8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:13.357450 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-616e7c67-a075-4eec-af79-44cb4fec56e8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:13.366580 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-616e7c67-a075-4eec-af79-44cb4fec56e8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:13.368017 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-616e7c67-a075-4eec-af79-44cb4fec56e8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:13.369171 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-616e7c67-a075-4eec-af79-44cb4fec56e8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.185034 Oct 04 08:57:13.369726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 356/671] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:13 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:14.405669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-dca01ad5-303a-4762-9af3-af2b5e9f2079 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:14.406512 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-dca01ad5-303a-4762-9af3-af2b5e9f2079 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:14.414711 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dca01ad5-303a-4762-9af3-af2b5e9f2079 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:14.415304 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dca01ad5-303a-4762-9af3-af2b5e9f2079 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:14.415838 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dca01ad5-303a-4762-9af3-af2b5e9f2079 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:14.416740 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dca01ad5-303a-4762-9af3-af2b5e9f2079 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:14.417301 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dca01ad5-303a-4762-9af3-af2b5e9f2079 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:14.417830 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dca01ad5-303a-4762-9af3-af2b5e9f2079 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:14.554548 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dca01ad5-303a-4762-9af3-af2b5e9f2079 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:14.556934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:14.564825 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dca01ad5-303a-4762-9af3-af2b5e9f2079 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:14.566253 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dca01ad5-303a-4762-9af3-af2b5e9f2079 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:14.567435 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-dca01ad5-303a-4762-9af3-af2b5e9f2079 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.169555 Oct 04 08:57:14.568021 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 316/672] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:14 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:15.597230 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1b0d98fa-5e1f-4ce6-a370-d56f89ef7c62 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:15.598238 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1b0d98fa-5e1f-4ce6-a370-d56f89ef7c62 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:15.608428 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1b0d98fa-5e1f-4ce6-a370-d56f89ef7c62 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:15.608892 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1b0d98fa-5e1f-4ce6-a370-d56f89ef7c62 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:15.609520 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1b0d98fa-5e1f-4ce6-a370-d56f89ef7c62 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:15.610268 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1b0d98fa-5e1f-4ce6-a370-d56f89ef7c62 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:15.610708 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1b0d98fa-5e1f-4ce6-a370-d56f89ef7c62 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:15.611221 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1b0d98fa-5e1f-4ce6-a370-d56f89ef7c62 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:15.988273 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1b0d98fa-5e1f-4ce6-a370-d56f89ef7c62 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:15.997744 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1b0d98fa-5e1f-4ce6-a370-d56f89ef7c62 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:15.999377 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1b0d98fa-5e1f-4ce6-a370-d56f89ef7c62 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:16.000680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1b0d98fa-5e1f-4ce6-a370-d56f89ef7c62 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.410230 Oct 04 08:57:16.001723 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 357/673] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:15 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:17.028168 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-424952ee-bc98-408e-8119-cb2893f5402b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:17.029298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-424952ee-bc98-408e-8119-cb2893f5402b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:17.039651 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-424952ee-bc98-408e-8119-cb2893f5402b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:17.040417 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-424952ee-bc98-408e-8119-cb2893f5402b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:17.040873 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-424952ee-bc98-408e-8119-cb2893f5402b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:17.041597 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-424952ee-bc98-408e-8119-cb2893f5402b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:17.042028 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-424952ee-bc98-408e-8119-cb2893f5402b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:17.042492 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-424952ee-bc98-408e-8119-cb2893f5402b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:17.172380 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-424952ee-bc98-408e-8119-cb2893f5402b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:17.181040 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-424952ee-bc98-408e-8119-cb2893f5402b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:17.182490 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-424952ee-bc98-408e-8119-cb2893f5402b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:17.183623 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-424952ee-bc98-408e-8119-cb2893f5402b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.160777 Oct 04 08:57:17.184245 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 317/674] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:17 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:18.209198 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5dc5954d-8a31-4ac5-ac8e-55b78d0d1992 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:18.209803 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5dc5954d-8a31-4ac5-ac8e-55b78d0d1992 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:18.211677 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=36 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:18.216951 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5dc5954d-8a31-4ac5-ac8e-55b78d0d1992 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:18.217434 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5dc5954d-8a31-4ac5-ac8e-55b78d0d1992 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:18.217868 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5dc5954d-8a31-4ac5-ac8e-55b78d0d1992 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:18.218608 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5dc5954d-8a31-4ac5-ac8e-55b78d0d1992 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:18.219096 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5dc5954d-8a31-4ac5-ac8e-55b78d0d1992 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:18.219514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5dc5954d-8a31-4ac5-ac8e-55b78d0d1992 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:18.357783 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5dc5954d-8a31-4ac5-ac8e-55b78d0d1992 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:18.367406 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5dc5954d-8a31-4ac5-ac8e-55b78d0d1992 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:18.368806 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5dc5954d-8a31-4ac5-ac8e-55b78d0d1992 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:18.369966 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5dc5954d-8a31-4ac5-ac8e-55b78d0d1992 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.164728 Oct 04 08:57:18.370526 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 358/675] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:18 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:19.400199 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-31303f77-96db-4260-91af-32625f2b3428 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:19.401121 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-31303f77-96db-4260-91af-32625f2b3428 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:19.412303 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-31303f77-96db-4260-91af-32625f2b3428 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:19.413095 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-31303f77-96db-4260-91af-32625f2b3428 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:19.413805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-31303f77-96db-4260-91af-32625f2b3428 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:19.414927 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-31303f77-96db-4260-91af-32625f2b3428 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:19.415662 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-31303f77-96db-4260-91af-32625f2b3428 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:19.416417 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-31303f77-96db-4260-91af-32625f2b3428 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:19.562511 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-31303f77-96db-4260-91af-32625f2b3428 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:19.571772 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-31303f77-96db-4260-91af-32625f2b3428 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:19.573245 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-31303f77-96db-4260-91af-32625f2b3428 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:19.574406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-31303f77-96db-4260-91af-32625f2b3428 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.180864 Oct 04 08:57:19.574974 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 318/676] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:19 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:20.604280 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d2fb0f94-efaf-461c-b169-a1202ed0dc3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:20.605218 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d2fb0f94-efaf-461c-b169-a1202ed0dc3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:20.613231 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d2fb0f94-efaf-461c-b169-a1202ed0dc3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:20.613738 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d2fb0f94-efaf-461c-b169-a1202ed0dc3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:20.614172 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d2fb0f94-efaf-461c-b169-a1202ed0dc3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:20.615349 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d2fb0f94-efaf-461c-b169-a1202ed0dc3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:20.615802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d2fb0f94-efaf-461c-b169-a1202ed0dc3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:20.616252 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d2fb0f94-efaf-461c-b169-a1202ed0dc3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:20.749706 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d2fb0f94-efaf-461c-b169-a1202ed0dc3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:20.758327 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d2fb0f94-efaf-461c-b169-a1202ed0dc3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:20.759743 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d2fb0f94-efaf-461c-b169-a1202ed0dc3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:20.760922 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d2fb0f94-efaf-461c-b169-a1202ed0dc3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.163321 Oct 04 08:57:20.761492 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 359/677] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:20 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:21.790388 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8d988a7b-f8a3-46a3-b4dd-35973b9564cb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:21.791393 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8d988a7b-f8a3-46a3-b4dd-35973b9564cb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:21.802356 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d988a7b-f8a3-46a3-b4dd-35973b9564cb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:21.803163 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d988a7b-f8a3-46a3-b4dd-35973b9564cb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:21.803932 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d988a7b-f8a3-46a3-b4dd-35973b9564cb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:21.805068 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d988a7b-f8a3-46a3-b4dd-35973b9564cb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:21.805822 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d988a7b-f8a3-46a3-b4dd-35973b9564cb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:21.806536 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d988a7b-f8a3-46a3-b4dd-35973b9564cb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:21.954140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8d988a7b-f8a3-46a3-b4dd-35973b9564cb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:21.962906 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8d988a7b-f8a3-46a3-b4dd-35973b9564cb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:21.964354 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8d988a7b-f8a3-46a3-b4dd-35973b9564cb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:21.965506 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8d988a7b-f8a3-46a3-b4dd-35973b9564cb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.181893 Oct 04 08:57:21.966066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 319/678] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:21 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:22.992245 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1ba79545-f125-4027-9e34-8b9076b81947 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:22.992854 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1ba79545-f125-4027-9e34-8b9076b81947 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:22.999323 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ba79545-f125-4027-9e34-8b9076b81947 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:22.999803 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ba79545-f125-4027-9e34-8b9076b81947 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:23.000255 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ba79545-f125-4027-9e34-8b9076b81947 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:23.000938 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ba79545-f125-4027-9e34-8b9076b81947 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:23.001384 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ba79545-f125-4027-9e34-8b9076b81947 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:23.001799 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1ba79545-f125-4027-9e34-8b9076b81947 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:23.004297 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=95 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:23.133909 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1ba79545-f125-4027-9e34-8b9076b81947 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:23.142717 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1ba79545-f125-4027-9e34-8b9076b81947 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:23.144196 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1ba79545-f125-4027-9e34-8b9076b81947 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:23.145353 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1ba79545-f125-4027-9e34-8b9076b81947 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.157505 Oct 04 08:57:23.145914 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 360/679] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:22 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:24.175399 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-43379d5b-aeb0-48bd-96f9-1741ba0424b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:24.176672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-43379d5b-aeb0-48bd-96f9-1741ba0424b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:24.187618 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-43379d5b-aeb0-48bd-96f9-1741ba0424b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:24.188157 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-43379d5b-aeb0-48bd-96f9-1741ba0424b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:24.188589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-43379d5b-aeb0-48bd-96f9-1741ba0424b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:24.189281 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-43379d5b-aeb0-48bd-96f9-1741ba0424b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:24.189729 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-43379d5b-aeb0-48bd-96f9-1741ba0424b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:24.190154 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-43379d5b-aeb0-48bd-96f9-1741ba0424b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:24.331510 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-43379d5b-aeb0-48bd-96f9-1741ba0424b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:24.341999 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-43379d5b-aeb0-48bd-96f9-1741ba0424b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:24.343816 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-43379d5b-aeb0-48bd-96f9-1741ba0424b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:24.345156 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-43379d5b-aeb0-48bd-96f9-1741ba0424b9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.176433 Oct 04 08:57:24.345714 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 320/680] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:24 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:25.370886 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e8cf9f3a-5742-4e92-a2e4-172832d8e4fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:25.371473 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e8cf9f3a-5742-4e92-a2e4-172832d8e4fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:25.377849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e8cf9f3a-5742-4e92-a2e4-172832d8e4fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:25.378338 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e8cf9f3a-5742-4e92-a2e4-172832d8e4fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:25.378806 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e8cf9f3a-5742-4e92-a2e4-172832d8e4fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:25.379544 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e8cf9f3a-5742-4e92-a2e4-172832d8e4fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:25.380025 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e8cf9f3a-5742-4e92-a2e4-172832d8e4fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:25.380442 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e8cf9f3a-5742-4e92-a2e4-172832d8e4fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:25.545963 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e8cf9f3a-5742-4e92-a2e4-172832d8e4fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:25.554476 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e8cf9f3a-5742-4e92-a2e4-172832d8e4fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:25.556157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e8cf9f3a-5742-4e92-a2e4-172832d8e4fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:25.557320 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e8cf9f3a-5742-4e92-a2e4-172832d8e4fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1808 microversion: 2.20 time: 0.190358 Oct 04 08:57:25.557877 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 361/681] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:25 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:26.584061 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-25cb54ea-36d0-408b-bd24-c10cbfeb3137 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:26.584873 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-25cb54ea-36d0-408b-bd24-c10cbfeb3137 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:26.591487 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-25cb54ea-36d0-408b-bd24-c10cbfeb3137 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:26.592016 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-25cb54ea-36d0-408b-bd24-c10cbfeb3137 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:26.592436 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-25cb54ea-36d0-408b-bd24-c10cbfeb3137 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:26.593203 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-25cb54ea-36d0-408b-bd24-c10cbfeb3137 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:26.593659 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-25cb54ea-36d0-408b-bd24-c10cbfeb3137 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:26.594084 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-25cb54ea-36d0-408b-bd24-c10cbfeb3137 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:26.728969 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-25cb54ea-36d0-408b-bd24-c10cbfeb3137 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:26.738491 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-25cb54ea-36d0-408b-bd24-c10cbfeb3137 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:26.740667 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-25cb54ea-36d0-408b-bd24-c10cbfeb3137 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:26.741843 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-25cb54ea-36d0-408b-bd24-c10cbfeb3137 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1795 microversion: 2.20 time: 0.162401 Oct 04 08:57:26.742653 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 321/682] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:26 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1795 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:57:26.783118 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6a4229a9-7eb2-446a-a972-fcf8042e4a74 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:26.789275 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6a4229a9-7eb2-446a-a972-fcf8042e4a74 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:26.789758 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6a4229a9-7eb2-446a-a972-fcf8042e4a74 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:26.790190 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6a4229a9-7eb2-446a-a972-fcf8042e4a74 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:26.849362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6a4229a9-7eb2-446a-a972-fcf8042e4a74 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Going to try to stop instance {{(pid=142438) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 08:57:26.901857 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6a4229a9-7eb2-446a-a972-fcf8042e4a74 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "POST /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/action" status: 202 len: 0 microversion: 2.1 time: 0.122198 Oct 04 08:57:26.902452 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 362/683] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Oct 4 08:57:26 2022] POST /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:57:26.911594 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-abb3d368-b152-4f98-87b8-ac7a466e37df tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:26.912300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-abb3d368-b152-4f98-87b8-ac7a466e37df tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:26.918411 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-abb3d368-b152-4f98-87b8-ac7a466e37df tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:26.918897 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-abb3d368-b152-4f98-87b8-ac7a466e37df tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:26.919331 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-abb3d368-b152-4f98-87b8-ac7a466e37df tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:26.920392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-abb3d368-b152-4f98-87b8-ac7a466e37df tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:26.921020 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-abb3d368-b152-4f98-87b8-ac7a466e37df tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:26.921515 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-abb3d368-b152-4f98-87b8-ac7a466e37df tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:27.050102 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-abb3d368-b152-4f98-87b8-ac7a466e37df tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:27.058452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-abb3d368-b152-4f98-87b8-ac7a466e37df tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.151515 Oct 04 08:57:27.059020 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 322/684] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:26 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:57:28.085964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-030d2cef-93b6-400d-b13b-0cadb957767c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:28.086928 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-030d2cef-93b6-400d-b13b-0cadb957767c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:28.095441 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-030d2cef-93b6-400d-b13b-0cadb957767c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:28.096172 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-030d2cef-93b6-400d-b13b-0cadb957767c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:28.096768 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-030d2cef-93b6-400d-b13b-0cadb957767c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:28.097747 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-030d2cef-93b6-400d-b13b-0cadb957767c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:28.098378 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-030d2cef-93b6-400d-b13b-0cadb957767c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:28.098953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-030d2cef-93b6-400d-b13b-0cadb957767c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:28.232881 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-030d2cef-93b6-400d-b13b-0cadb957767c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:28.241836 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-030d2cef-93b6-400d-b13b-0cadb957767c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.161857 Oct 04 08:57:28.242398 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 363/685] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:28 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:29.269857 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ba0cfd95-a23d-4139-b1d3-19a70310edad tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:29.270832 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ba0cfd95-a23d-4139-b1d3-19a70310edad tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:29.274924 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=30 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:29.283976 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ba0cfd95-a23d-4139-b1d3-19a70310edad tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:29.284712 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ba0cfd95-a23d-4139-b1d3-19a70310edad tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:29.285150 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ba0cfd95-a23d-4139-b1d3-19a70310edad tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:29.285850 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ba0cfd95-a23d-4139-b1d3-19a70310edad tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:29.286326 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ba0cfd95-a23d-4139-b1d3-19a70310edad tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:29.286733 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ba0cfd95-a23d-4139-b1d3-19a70310edad tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:29.427333 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ba0cfd95-a23d-4139-b1d3-19a70310edad tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:29.435684 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ba0cfd95-a23d-4139-b1d3-19a70310edad tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.172933 Oct 04 08:57:29.436284 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 323/686] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:29 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:30.458975 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-957a4118-8814-4502-b35b-b5251a530435 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:30.459594 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-957a4118-8814-4502-b35b-b5251a530435 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:30.465687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-957a4118-8814-4502-b35b-b5251a530435 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:30.466163 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-957a4118-8814-4502-b35b-b5251a530435 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:30.466586 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-957a4118-8814-4502-b35b-b5251a530435 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:30.467259 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-957a4118-8814-4502-b35b-b5251a530435 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:30.467693 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-957a4118-8814-4502-b35b-b5251a530435 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:30.468148 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-957a4118-8814-4502-b35b-b5251a530435 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:30.609417 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-957a4118-8814-4502-b35b-b5251a530435 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:30.618235 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-957a4118-8814-4502-b35b-b5251a530435 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.163268 Oct 04 08:57:30.618794 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 364/687] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:30 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:31.642111 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-30580f75-14b4-4b4a-afa9-113361c62427 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:31.642775 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-30580f75-14b4-4b4a-afa9-113361c62427 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:31.650160 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-30580f75-14b4-4b4a-afa9-113361c62427 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:31.650646 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-30580f75-14b4-4b4a-afa9-113361c62427 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:31.651086 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-30580f75-14b4-4b4a-afa9-113361c62427 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:31.651783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-30580f75-14b4-4b4a-afa9-113361c62427 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:31.652285 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-30580f75-14b4-4b4a-afa9-113361c62427 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:31.652719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-30580f75-14b4-4b4a-afa9-113361c62427 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:31.798481 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-30580f75-14b4-4b4a-afa9-113361c62427 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:31.806808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-30580f75-14b4-4b4a-afa9-113361c62427 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.168741 Oct 04 08:57:31.807408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 324/688] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:31 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:32.830486 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5d58a9ff-12bd-47fc-8805-53c30b39ac5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:32.831153 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5d58a9ff-12bd-47fc-8805-53c30b39ac5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:32.837363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5d58a9ff-12bd-47fc-8805-53c30b39ac5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:32.837848 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5d58a9ff-12bd-47fc-8805-53c30b39ac5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:32.838277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5d58a9ff-12bd-47fc-8805-53c30b39ac5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:32.838967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5d58a9ff-12bd-47fc-8805-53c30b39ac5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:32.839417 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5d58a9ff-12bd-47fc-8805-53c30b39ac5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:32.839843 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5d58a9ff-12bd-47fc-8805-53c30b39ac5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:32.969173 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5d58a9ff-12bd-47fc-8805-53c30b39ac5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:32.977913 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5d58a9ff-12bd-47fc-8805-53c30b39ac5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.151303 Oct 04 08:57:32.978549 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 365/689] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:32 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:33.854715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a0173ebd-2107-46d8-a6e1-24724d4dd11b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:33.855224 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a0173ebd-2107-46d8-a6e1-24724d4dd11b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:33.862102 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0173ebd-2107-46d8-a6e1-24724d4dd11b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:33.862589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0173ebd-2107-46d8-a6e1-24724d4dd11b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:33.863069 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0173ebd-2107-46d8-a6e1-24724d4dd11b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:33.863757 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0173ebd-2107-46d8-a6e1-24724d4dd11b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:33.864255 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0173ebd-2107-46d8-a6e1-24724d4dd11b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:33.865034 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a0173ebd-2107-46d8-a6e1-24724d4dd11b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:33.947628 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-a0173ebd-2107-46d8-a6e1-24724d4dd11b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lazy-loading 'services' on Instance uuid c9a2c88e-2a5a-4452-9fef-e8275214033e {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:57:34.001901 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-11fbff0f-1847-4e17-a394-919156adcc8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:34.003192 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-11fbff0f-1847-4e17-a394-919156adcc8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:34.010450 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fbff0f-1847-4e17-a394-919156adcc8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:34.010944 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fbff0f-1847-4e17-a394-919156adcc8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:34.011372 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fbff0f-1847-4e17-a394-919156adcc8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:34.012085 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fbff0f-1847-4e17-a394-919156adcc8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:34.012539 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fbff0f-1847-4e17-a394-919156adcc8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:34.012955 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fbff0f-1847-4e17-a394-919156adcc8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:34.024756 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a0173ebd-2107-46d8-a6e1-24724d4dd11b tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e/os-volume_attachments/43f37399-e9fe-49b7-8870-74348ea810ac" status: 202 len: 0 microversion: 2.1 time: 0.173979 Oct 04 08:57:34.025477 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 325/690] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Oct 4 08:57:33 2022] DELETE /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e/os-volume_attachments/43f37399-e9fe-49b7-8870-74348ea810ac => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:57:34.149500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-11fbff0f-1847-4e17-a394-919156adcc8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:34.158225 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-11fbff0f-1847-4e17-a394-919156adcc8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.160292 Oct 04 08:57:34.158962 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 366/691] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:33 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:57:35.183115 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-aec04b2e-718d-4fe5-924e-240702861a53 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:35.183801 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-aec04b2e-718d-4fe5-924e-240702861a53 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:35.190124 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aec04b2e-718d-4fe5-924e-240702861a53 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:35.190683 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aec04b2e-718d-4fe5-924e-240702861a53 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:35.191117 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aec04b2e-718d-4fe5-924e-240702861a53 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:35.191832 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aec04b2e-718d-4fe5-924e-240702861a53 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:35.192313 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aec04b2e-718d-4fe5-924e-240702861a53 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:35.192738 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aec04b2e-718d-4fe5-924e-240702861a53 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:35.326837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-aec04b2e-718d-4fe5-924e-240702861a53 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:35.335241 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-aec04b2e-718d-4fe5-924e-240702861a53 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.157070 Oct 04 08:57:35.335800 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 326/692] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:35 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:36.366012 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a4b0f855-3924-4ea5-b899-1b16a3e2239f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:36.366576 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a4b0f855-3924-4ea5-b899-1b16a3e2239f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:36.373169 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4b0f855-3924-4ea5-b899-1b16a3e2239f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:36.373647 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4b0f855-3924-4ea5-b899-1b16a3e2239f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:36.374080 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4b0f855-3924-4ea5-b899-1b16a3e2239f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:36.374762 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4b0f855-3924-4ea5-b899-1b16a3e2239f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:36.375236 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4b0f855-3924-4ea5-b899-1b16a3e2239f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:36.375632 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4b0f855-3924-4ea5-b899-1b16a3e2239f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:36.509275 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-a4b0f855-3924-4ea5-b899-1b16a3e2239f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:36.517995 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a4b0f855-3924-4ea5-b899-1b16a3e2239f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.156753 Oct 04 08:57:36.518571 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 367/693] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:36 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:37.545502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6c0b1b32-eeff-4166-bfe4-9b223f53723a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:37.546453 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6c0b1b32-eeff-4166-bfe4-9b223f53723a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:37.557378 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c0b1b32-eeff-4166-bfe4-9b223f53723a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:37.558179 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c0b1b32-eeff-4166-bfe4-9b223f53723a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:37.558898 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c0b1b32-eeff-4166-bfe4-9b223f53723a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:37.560062 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c0b1b32-eeff-4166-bfe4-9b223f53723a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:37.560808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c0b1b32-eeff-4166-bfe4-9b223f53723a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:37.561549 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c0b1b32-eeff-4166-bfe4-9b223f53723a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:37.715198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6c0b1b32-eeff-4166-bfe4-9b223f53723a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:37.724852 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6c0b1b32-eeff-4166-bfe4-9b223f53723a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.185971 Oct 04 08:57:37.725412 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 327/694] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:37 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:38.752672 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4d9db2ee-5c1d-421f-b6a7-5ac0d06399f8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:38.753493 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4d9db2ee-5c1d-421f-b6a7-5ac0d06399f8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:38.763662 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4d9db2ee-5c1d-421f-b6a7-5ac0d06399f8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:38.764523 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4d9db2ee-5c1d-421f-b6a7-5ac0d06399f8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:38.765231 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4d9db2ee-5c1d-421f-b6a7-5ac0d06399f8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:38.766351 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4d9db2ee-5c1d-421f-b6a7-5ac0d06399f8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:38.767089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4d9db2ee-5c1d-421f-b6a7-5ac0d06399f8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:38.767796 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4d9db2ee-5c1d-421f-b6a7-5ac0d06399f8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:38.903337 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4d9db2ee-5c1d-421f-b6a7-5ac0d06399f8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:38.912967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4d9db2ee-5c1d-421f-b6a7-5ac0d06399f8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.166919 Oct 04 08:57:38.913546 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 368/695] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:38 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:39.422744 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d1011be4-940e-4c58-a283-c5b2dd90ae88 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:39.423220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d1011be4-940e-4c58-a283-c5b2dd90ae88 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:39.430051 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d1011be4-940e-4c58-a283-c5b2dd90ae88 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:39.430568 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d1011be4-940e-4c58-a283-c5b2dd90ae88 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:39.430998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d1011be4-940e-4c58-a283-c5b2dd90ae88 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:39.431684 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d1011be4-940e-4c58-a283-c5b2dd90ae88 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:39.432162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d1011be4-940e-4c58-a283-c5b2dd90ae88 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:39.432591 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d1011be4-940e-4c58-a283-c5b2dd90ae88 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:39.468305 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d1011be4-940e-4c58-a283-c5b2dd90ae88 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Going to try to terminate instance {{(pid=142439) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:57:39.539311 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d1011be4-940e-4c58-a283-c5b2dd90ae88 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 204 len: 0 microversion: 2.1 time: 0.120085 Oct 04 08:57:39.539931 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 328/696] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 08:57:39 2022] DELETE /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:57:39.549312 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-08530483-7eb6-463f-b06f-b14677fcdc25 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:39.550192 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-08530483-7eb6-463f-b06f-b14677fcdc25 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:39.557337 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08530483-7eb6-463f-b06f-b14677fcdc25 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:39.557879 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08530483-7eb6-463f-b06f-b14677fcdc25 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:39.558402 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08530483-7eb6-463f-b06f-b14677fcdc25 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:39.559157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08530483-7eb6-463f-b06f-b14677fcdc25 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:39.559667 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08530483-7eb6-463f-b06f-b14677fcdc25 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:39.560185 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-08530483-7eb6-463f-b06f-b14677fcdc25 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:39.692871 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-08530483-7eb6-463f-b06f-b14677fcdc25 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:39.700626 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-08530483-7eb6-463f-b06f-b14677fcdc25 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1512 microversion: 2.1 time: 0.155766 Oct 04 08:57:39.701158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 369/697] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:39 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:57:39.942774 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-24f7b87d-27a4-4ca7-826a-0f112a12779c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:39.943375 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-24f7b87d-27a4-4ca7-826a-0f112a12779c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:39.949566 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-24f7b87d-27a4-4ca7-826a-0f112a12779c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:39.950056 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-24f7b87d-27a4-4ca7-826a-0f112a12779c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:39.950487 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-24f7b87d-27a4-4ca7-826a-0f112a12779c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:39.951156 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-24f7b87d-27a4-4ca7-826a-0f112a12779c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:39.951621 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-24f7b87d-27a4-4ca7-826a-0f112a12779c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:39.952082 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-24f7b87d-27a4-4ca7-826a-0f112a12779c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:40.080810 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-24f7b87d-27a4-4ca7-826a-0f112a12779c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:40.089295 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-24f7b87d-27a4-4ca7-826a-0f112a12779c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.154142 Oct 04 08:57:40.089886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 329/698] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:39 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:40.724421 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2a97b55e-bc8e-43f5-9733-f1d7ab32f5f5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:40.725088 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2a97b55e-bc8e-43f5-9733-f1d7ab32f5f5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:40.731512 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a97b55e-bc8e-43f5-9733-f1d7ab32f5f5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:40.732020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a97b55e-bc8e-43f5-9733-f1d7ab32f5f5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:40.732450 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a97b55e-bc8e-43f5-9733-f1d7ab32f5f5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:40.733142 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a97b55e-bc8e-43f5-9733-f1d7ab32f5f5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:40.733598 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a97b55e-bc8e-43f5-9733-f1d7ab32f5f5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:40.734014 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a97b55e-bc8e-43f5-9733-f1d7ab32f5f5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:40.867081 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2a97b55e-bc8e-43f5-9733-f1d7ab32f5f5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:40.874782 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2a97b55e-bc8e-43f5-9733-f1d7ab32f5f5 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1512 microversion: 2.1 time: 0.154325 Oct 04 08:57:40.875427 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 370/699] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:40 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:41.113271 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b73b9d73-61fe-4c86-be76-312abb654e8d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:41.124198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b73b9d73-61fe-4c86-be76-312abb654e8d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:41.124198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b73b9d73-61fe-4c86-be76-312abb654e8d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:41.124198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b73b9d73-61fe-4c86-be76-312abb654e8d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:41.124198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b73b9d73-61fe-4c86-be76-312abb654e8d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:41.124899 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b73b9d73-61fe-4c86-be76-312abb654e8d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:41.124899 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b73b9d73-61fe-4c86-be76-312abb654e8d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:41.124899 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b73b9d73-61fe-4c86-be76-312abb654e8d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:41.257000 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b73b9d73-61fe-4c86-be76-312abb654e8d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:41.266399 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b73b9d73-61fe-4c86-be76-312abb654e8d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.157266 Oct 04 08:57:41.266901 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 330/700] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:41 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:41.902305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6aa336b1-ea7f-4336-86d2-cb823e001e48 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:41.903145 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6aa336b1-ea7f-4336-86d2-cb823e001e48 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:41.913145 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6aa336b1-ea7f-4336-86d2-cb823e001e48 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:41.913618 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6aa336b1-ea7f-4336-86d2-cb823e001e48 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:41.914046 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6aa336b1-ea7f-4336-86d2-cb823e001e48 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:41.914724 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6aa336b1-ea7f-4336-86d2-cb823e001e48 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:41.915167 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6aa336b1-ea7f-4336-86d2-cb823e001e48 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:41.915578 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6aa336b1-ea7f-4336-86d2-cb823e001e48 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:42.061929 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6aa336b1-ea7f-4336-86d2-cb823e001e48 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:42.070157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6aa336b1-ea7f-4336-86d2-cb823e001e48 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1512 microversion: 2.1 time: 0.174473 Oct 04 08:57:42.070710 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 371/701] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:41 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:42.296300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d2beb4c3-d4d6-4e7e-b71b-ea495293b5b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:42.296853 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d2beb4c3-d4d6-4e7e-b71b-ea495293b5b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:42.303744 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d2beb4c3-d4d6-4e7e-b71b-ea495293b5b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:42.304265 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d2beb4c3-d4d6-4e7e-b71b-ea495293b5b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:42.304691 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d2beb4c3-d4d6-4e7e-b71b-ea495293b5b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:42.305377 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d2beb4c3-d4d6-4e7e-b71b-ea495293b5b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:42.305821 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d2beb4c3-d4d6-4e7e-b71b-ea495293b5b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:42.306238 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d2beb4c3-d4d6-4e7e-b71b-ea495293b5b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:42.308875 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:42.437443 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d2beb4c3-d4d6-4e7e-b71b-ea495293b5b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:42.449354 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d2beb4c3-d4d6-4e7e-b71b-ea495293b5b6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.156497 Oct 04 08:57:42.449955 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 331/702] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:42 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:43.098017 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-95696acf-486d-42c3-8f73-6dff45b01ce7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:43.098858 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-95696acf-486d-42c3-8f73-6dff45b01ce7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:43.109034 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-95696acf-486d-42c3-8f73-6dff45b01ce7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:43.109805 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-95696acf-486d-42c3-8f73-6dff45b01ce7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:43.110596 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-95696acf-486d-42c3-8f73-6dff45b01ce7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:43.111698 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-95696acf-486d-42c3-8f73-6dff45b01ce7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:43.112506 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-95696acf-486d-42c3-8f73-6dff45b01ce7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:43.113211 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-95696acf-486d-42c3-8f73-6dff45b01ce7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:43.255257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-95696acf-486d-42c3-8f73-6dff45b01ce7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:43.263146 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-95696acf-486d-42c3-8f73-6dff45b01ce7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1512 microversion: 2.1 time: 0.171761 Oct 04 08:57:43.263945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 372/703] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:43 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:43.478113 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-578bf089-10f2-4a85-8569-2231c47fb28d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:43.478661 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-578bf089-10f2-4a85-8569-2231c47fb28d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:43.485751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-578bf089-10f2-4a85-8569-2231c47fb28d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:43.486236 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-578bf089-10f2-4a85-8569-2231c47fb28d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:43.486711 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-578bf089-10f2-4a85-8569-2231c47fb28d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:43.487406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-578bf089-10f2-4a85-8569-2231c47fb28d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:43.487851 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-578bf089-10f2-4a85-8569-2231c47fb28d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:43.488310 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-578bf089-10f2-4a85-8569-2231c47fb28d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:43.640565 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-578bf089-10f2-4a85-8569-2231c47fb28d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:43.649063 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-578bf089-10f2-4a85-8569-2231c47fb28d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.175902 Oct 04 08:57:43.649627 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 332/704] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:43 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:44.291312 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-eb027424-2d24-4083-9820-f6efa047a9f7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:44.292285 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-eb027424-2d24-4083-9820-f6efa047a9f7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:44.302444 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-eb027424-2d24-4083-9820-f6efa047a9f7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:44.303320 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-eb027424-2d24-4083-9820-f6efa047a9f7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:44.304172 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-eb027424-2d24-4083-9820-f6efa047a9f7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:44.305258 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-eb027424-2d24-4083-9820-f6efa047a9f7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:44.305998 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-eb027424-2d24-4083-9820-f6efa047a9f7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:44.306748 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-eb027424-2d24-4083-9820-f6efa047a9f7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:44.438298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-eb027424-2d24-4083-9820-f6efa047a9f7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:44.449601 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-eb027424-2d24-4083-9820-f6efa047a9f7 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1512 microversion: 2.1 time: 0.164599 Oct 04 08:57:44.450353 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 373/705] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:44 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:44.673566 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f96290a4-45df-450d-a90b-9016bd7f627a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:44.674360 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f96290a4-45df-450d-a90b-9016bd7f627a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:44.681420 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f96290a4-45df-450d-a90b-9016bd7f627a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:44.681917 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f96290a4-45df-450d-a90b-9016bd7f627a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:44.682349 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f96290a4-45df-450d-a90b-9016bd7f627a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:44.683039 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f96290a4-45df-450d-a90b-9016bd7f627a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:44.683491 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f96290a4-45df-450d-a90b-9016bd7f627a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:44.683918 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f96290a4-45df-450d-a90b-9016bd7f627a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:44.815602 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f96290a4-45df-450d-a90b-9016bd7f627a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:44.824525 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f96290a4-45df-450d-a90b-9016bd7f627a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.155354 Oct 04 08:57:44.825094 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 333/706] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:44 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:45.477769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ec6877e7-6a9c-4c96-986a-ff84a2819477 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:45.478537 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ec6877e7-6a9c-4c96-986a-ff84a2819477 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:45.486453 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ec6877e7-6a9c-4c96-986a-ff84a2819477 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:45.487062 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ec6877e7-6a9c-4c96-986a-ff84a2819477 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:45.487602 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ec6877e7-6a9c-4c96-986a-ff84a2819477 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:45.488506 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ec6877e7-6a9c-4c96-986a-ff84a2819477 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:45.489030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ec6877e7-6a9c-4c96-986a-ff84a2819477 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:45.489597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ec6877e7-6a9c-4c96-986a-ff84a2819477 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:45.619093 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ec6877e7-6a9c-4c96-986a-ff84a2819477 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:45.627438 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ec6877e7-6a9c-4c96-986a-ff84a2819477 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1512 microversion: 2.1 time: 0.154510 Oct 04 08:57:45.627968 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 374/707] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:45 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:45.851782 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1d9cbfab-e1da-48fc-a8ad-ee0706fb1911 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:45.852419 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1d9cbfab-e1da-48fc-a8ad-ee0706fb1911 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:45.860932 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1d9cbfab-e1da-48fc-a8ad-ee0706fb1911 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:45.861636 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1d9cbfab-e1da-48fc-a8ad-ee0706fb1911 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:45.862214 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1d9cbfab-e1da-48fc-a8ad-ee0706fb1911 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:45.863239 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1d9cbfab-e1da-48fc-a8ad-ee0706fb1911 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:45.863863 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1d9cbfab-e1da-48fc-a8ad-ee0706fb1911 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:45.864490 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1d9cbfab-e1da-48fc-a8ad-ee0706fb1911 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:46.007281 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1d9cbfab-e1da-48fc-a8ad-ee0706fb1911 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:46.015918 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1d9cbfab-e1da-48fc-a8ad-ee0706fb1911 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1723 microversion: 2.1 time: 0.169678 Oct 04 08:57:46.016488 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 334/708] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:45 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:46.651010 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e79b4144-77bd-45f5-8e1b-5c0fc598d821 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:46.651967 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e79b4144-77bd-45f5-8e1b-5c0fc598d821 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:46.660262 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e79b4144-77bd-45f5-8e1b-5c0fc598d821 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:46.660997 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e79b4144-77bd-45f5-8e1b-5c0fc598d821 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:46.661438 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e79b4144-77bd-45f5-8e1b-5c0fc598d821 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:46.662147 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e79b4144-77bd-45f5-8e1b-5c0fc598d821 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:46.662745 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e79b4144-77bd-45f5-8e1b-5c0fc598d821 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:46.663260 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e79b4144-77bd-45f5-8e1b-5c0fc598d821 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:46.679353 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-3150c254-b059-4ece-9aa5-771b19cee3fa req-c532b94a-1347-4d43-ba0b-267c316e0805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a2c88e-2a5a-4452-9fef-e8275214033e", "name": "network-vif-deleted", "tag": "d9944987-01b7-4522-a286-29b930805806"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:46.688981 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-3150c254-b059-4ece-9aa5-771b19cee3fa req-c532b94a-1347-4d43-ba0b-267c316e0805 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:46.689452 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-3150c254-b059-4ece-9aa5-771b19cee3fa req-c532b94a-1347-4d43-ba0b-267c316e0805 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:46.689879 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-3150c254-b059-4ece-9aa5-771b19cee3fa req-c532b94a-1347-4d43-ba0b-267c316e0805 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:46.701230 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-3150c254-b059-4ece-9aa5-771b19cee3fa req-c532b94a-1347-4d43-ba0b-267c316e0805 service nova] Creating event network-vif-deleted:d9944987-01b7-4522-a286-29b930805806 for instance c9a2c88e-2a5a-4452-9fef-e8275214033e on hv-cinder-84456 Oct 04 08:57:46.706833 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-3150c254-b059-4ece-9aa5-771b19cee3fa req-c532b94a-1347-4d43-ba0b-267c316e0805 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088345 Oct 04 08:57:46.707505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 375/709] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:46.729869 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e79b4144-77bd-45f5-8e1b-5c0fc598d821 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e44ee032c5346ec9260740bcb700007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b474ba7f7a465caa2ed14f891ac951', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:46.737810 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e79b4144-77bd-45f5-8e1b-5c0fc598d821 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 200 len: 1303 microversion: 2.1 time: 0.090801 Oct 04 08:57:46.738386 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 335/710] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:46 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:57:47.039072 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4b2738ad-0518-4462-90b6-bd970e759fcd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:47.039856 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4b2738ad-0518-4462-90b6-bd970e759fcd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:47.047467 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4b2738ad-0518-4462-90b6-bd970e759fcd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:47.047966 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4b2738ad-0518-4462-90b6-bd970e759fcd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:47.048400 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4b2738ad-0518-4462-90b6-bd970e759fcd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:47.049094 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4b2738ad-0518-4462-90b6-bd970e759fcd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:47.049800 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4b2738ad-0518-4462-90b6-bd970e759fcd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:47.049908 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4b2738ad-0518-4462-90b6-bd970e759fcd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:47.065526 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:47.260897 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4b2738ad-0518-4462-90b6-bd970e759fcd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:47.269463 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4b2738ad-0518-4462-90b6-bd970e759fcd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1700 microversion: 2.1 time: 0.234572 Oct 04 08:57:47.270027 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 376/711] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:47 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1700 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:47.292338 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0f16cd02-eeda-4f0d-91ba-8d505e665405 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:47.298937 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0f16cd02-eeda-4f0d-91ba-8d505e665405 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:47.299515 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0f16cd02-eeda-4f0d-91ba-8d505e665405 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:47.299849 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0f16cd02-eeda-4f0d-91ba-8d505e665405 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:47.361734 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0f16cd02-eeda-4f0d-91ba-8d505e665405 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Going to try to start instance {{(pid=142439) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 08:57:47.413263 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0f16cd02-eeda-4f0d-91ba-8d505e665405 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "POST /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/action" status: 202 len: 0 microversion: 2.1 time: 0.124684 Oct 04 08:57:47.414441 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 336/712] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Oct 4 08:57:47 2022] POST /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:57:47.427067 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0fb6fdb0-8c05-402d-b7e8-e50cf02c04dd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:47.427763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0fb6fdb0-8c05-402d-b7e8-e50cf02c04dd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:47.434971 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0fb6fdb0-8c05-402d-b7e8-e50cf02c04dd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:47.435722 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0fb6fdb0-8c05-402d-b7e8-e50cf02c04dd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:47.437397 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0fb6fdb0-8c05-402d-b7e8-e50cf02c04dd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:47.438128 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0fb6fdb0-8c05-402d-b7e8-e50cf02c04dd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:47.438598 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0fb6fdb0-8c05-402d-b7e8-e50cf02c04dd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:47.438994 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0fb6fdb0-8c05-402d-b7e8-e50cf02c04dd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:47.662533 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0fb6fdb0-8c05-402d-b7e8-e50cf02c04dd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:47.671658 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0fb6fdb0-8c05-402d-b7e8-e50cf02c04dd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1709 microversion: 2.1 time: 0.248406 Oct 04 08:57:47.672280 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 377/713] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:47 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1709 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:47.761916 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-3f36131e-30aa-4881-b76a-f11642f18db9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:47.762736 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-3f36131e-30aa-4881-b76a-f11642f18db9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] [instance: c9a2c88e-2a5a-4452-9fef-e8275214033e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:47.775355 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3f36131e-30aa-4881-b76a-f11642f18db9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:47.775950 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3f36131e-30aa-4881-b76a-f11642f18db9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:47.776447 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3f36131e-30aa-4881-b76a-f11642f18db9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:47.777224 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3f36131e-30aa-4881-b76a-f11642f18db9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:47.777759 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3f36131e-30aa-4881-b76a-f11642f18db9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:47.778184 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3f36131e-30aa-4881-b76a-f11642f18db9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:47.791954 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-3f36131e-30aa-4881-b76a-f11642f18db9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] HTTP exception thrown: Instance c9a2c88e-2a5a-4452-9fef-e8275214033e could not be found. Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-3f36131e-30aa-4881-b76a-f11642f18db9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Request method failure captured: Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e HTTP/1.1 Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_StDtfzIhrgKzYaDab3kNj8G11HByOK-nwvTWdEX0NVtjVV-s0r29JeuDMbG_lXiaZ4USrPmYcyJqVBQ48O1bTr1GxckRSvUTIh45_Snu7BG-vfcq5b7b1xtU2DHxk_YAX-LGzTpqkx0DFdN1pOJdtZg8bA3D7w-A1M9jtoxJa7_ko Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 67b474ba7f7a465caa2ed14f891ac951 Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1449085317 Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 08:57:47.793609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 08:57:47.794938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_67b474ba7f7a465caa2ed14f891ac951", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/67b474ba7f7a465caa2ed14f891ac951"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/67b474ba7f7a465caa2ed14f891ac951"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/67b474ba7f7a465caa2ed14f891ac951"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:57:47.794938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-VolumesSnapshotTestJSON-1449085317 Oct 04 08:57:47.794938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 67b474ba7f7a465caa2ed14f891ac951 Oct 04 08:57:47.794938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1449085317 Oct 04 08:57:47.794938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-VolumesSnapshotTestJSON-1449085317-project Oct 04 08:57:47.794938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 08:57:47.794938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 08:57:47.794938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 1e44ee032c5346ec9260740bcb700007 Oct 04 08:57:47.794938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-VolumesSnapshotTestJSON-1449085317-project Oct 04 08:57:47.794938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 08:57:47.794938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance c9a2c88e-2a5a-4452-9fef-e8275214033e could not be found. Oct 04 08:57:47.794938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': 'c9a2c88e-2a5a-4452-9fef-e8275214033e'} Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a2c88e-2a5a-4452-9fef-e8275214033e could not be found. Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:57:47.795672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a2c88e-2a5a-4452-9fef-e8275214033e could not be found. Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a2c88e-2a5a-4452-9fef-e8275214033e could not be found. Oct 04 08:57:47.796942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 08:57:47.798076 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-3f36131e-30aa-4881-b76a-f11642f18db9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] Returning 404 to user: Instance c9a2c88e-2a5a-4452-9fef-e8275214033e could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:57:47.798076 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-3f36131e-30aa-4881-b76a-f11642f18db9 tempest-VolumesSnapshotTestJSON-1449085317 tempest-VolumesSnapshotTestJSON-1449085317-project] 10.222.0.44 "GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e" status: 404 len: 111 microversion: 2.1 time: 0.037429 Oct 04 08:57:47.807930 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 337/714] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:47 2022] GET /compute/v2.1/servers/c9a2c88e-2a5a-4452-9fef-e8275214033e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:57:48.699290 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-224b2da9-f4cb-4cfb-a586-1a4601209e8e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:48.699852 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-224b2da9-f4cb-4cfb-a586-1a4601209e8e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:48.701769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=40 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:48.707368 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-224b2da9-f4cb-4cfb-a586-1a4601209e8e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:48.707867 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-224b2da9-f4cb-4cfb-a586-1a4601209e8e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:48.708339 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-224b2da9-f4cb-4cfb-a586-1a4601209e8e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:48.709082 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-224b2da9-f4cb-4cfb-a586-1a4601209e8e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:48.709550 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-224b2da9-f4cb-4cfb-a586-1a4601209e8e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:48.710006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-224b2da9-f4cb-4cfb-a586-1a4601209e8e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:48.850828 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-224b2da9-f4cb-4cfb-a586-1a4601209e8e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:48.861782 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-224b2da9-f4cb-4cfb-a586-1a4601209e8e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1709 microversion: 2.1 time: 0.166661 Oct 04 08:57:48.862608 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 378/715] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:48 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1709 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:49.886686 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fdc52bdb-02e3-4228-ae2b-b56255b8b37c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:49.887286 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-fdc52bdb-02e3-4228-ae2b-b56255b8b37c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:49.894183 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fdc52bdb-02e3-4228-ae2b-b56255b8b37c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:49.894695 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fdc52bdb-02e3-4228-ae2b-b56255b8b37c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:49.895285 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fdc52bdb-02e3-4228-ae2b-b56255b8b37c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:49.896071 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fdc52bdb-02e3-4228-ae2b-b56255b8b37c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:49.896553 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fdc52bdb-02e3-4228-ae2b-b56255b8b37c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:49.896995 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fdc52bdb-02e3-4228-ae2b-b56255b8b37c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:50.044874 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-fdc52bdb-02e3-4228-ae2b-b56255b8b37c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:50.056918 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fdc52bdb-02e3-4228-ae2b-b56255b8b37c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1713 microversion: 2.1 time: 0.174555 Oct 04 08:57:50.057629 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 338/716] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:49 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1713 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:26.421232 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:26.422563 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=15 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:26.661756 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-3f986d8f-90a7-4cba-963e-5a060e235e87 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad04fac4-3f96-4fa6-9e49-30fdcf77be97"}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:26.665970 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-3f986d8f-90a7-4cba-963e-5a060e235e87 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:26.671427 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3f986d8f-90a7-4cba-963e-5a060e235e87 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:26.672076 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3f986d8f-90a7-4cba-963e-5a060e235e87 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:26.672716 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3f986d8f-90a7-4cba-963e-5a060e235e87 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:26.673484 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3f986d8f-90a7-4cba-963e-5a060e235e87 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:26.674008 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3f986d8f-90a7-4cba-963e-5a060e235e87 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:26.674483 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3f986d8f-90a7-4cba-963e-5a060e235e87 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:27.041193 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-3f986d8f-90a7-4cba-963e-5a060e235e87 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "POST /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.624525 Oct 04 08:58:27.042195 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 379/717] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Oct 4 08:58:26 2022] POST /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/os-volume_attachments => generated 194 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:34.235218 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-85df92e4-e082-4f92-a607-1ac928683432 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Action: 'create', calling method: .version_select at 0x7ff92e31d0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-354667437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMR03jhVFK3MczgZQkVo2lTTi3oWsDEZx/oKL5r2If4RdRaPsEfhI3KrK4bzTv6d5eGhctDoHoxQ34Jym6J1D8ln5Ab16mzuAbVSFdT68dikRfiUjPWfwql1HpqCIyDBIA=="}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:34.242389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:34.243038 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:34.258635 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-85df92e4-e082-4f92-a607-1ac928683432 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Getting quotas for project 62a1577879c64dc6aac3d5fd4d7ad637. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:58:34.263658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-85df92e4-e082-4f92-a607-1ac928683432 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Getting quotas for user 3fb4f49a5be0475889369e13c3bc1481 and project 62a1577879c64dc6aac3d5fd4d7ad637. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:58:34.289147 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-85df92e4-e082-4f92-a607-1ac928683432 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.057966 Oct 04 08:58:34.289759 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 339/718] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Oct 4 08:58:34 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:34.339310 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 08:58:34.339850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Tue Oct 4 08:58:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.44) !!! Oct 04 08:58:34.344110 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2051425381", "imageRef": "697e896d-e9a4-41b2-976d-21b912375104", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-354667437", "networks": [{"uuid": "8ef07a90-87be-409a-a6b0-c7cd8ef81983"}]}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:34.397884 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.network.neutron [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] validate_networks() for [('8ef07a90-87be-409a-a6b0-c7cd8ef81983', None, None, None, None, None)] {{(pid=142438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:58:34.652741 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8d5a3123-d236-44f2-beb8-6bbe63e0e118 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:34.654919 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8d5a3123-d236-44f2-beb8-6bbe63e0e118 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:34.661229 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d5a3123-d236-44f2-beb8-6bbe63e0e118 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:34.661717 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d5a3123-d236-44f2-beb8-6bbe63e0e118 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:34.662172 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d5a3123-d236-44f2-beb8-6bbe63e0e118 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:34.662875 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d5a3123-d236-44f2-beb8-6bbe63e0e118 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:34.663327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d5a3123-d236-44f2-beb8-6bbe63e0e118 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:34.663749 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8d5a3123-d236-44f2-beb8-6bbe63e0e118 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:34.687779 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-8d5a3123-d236-44f2-beb8-6bbe63e0e118 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lazy-loading 'flavor' on Instance uuid e8d4e170-63f9-4fa3-858f-9be84ff18613 {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:58:34.854017 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8d5a3123-d236-44f2-beb8-6bbe63e0e118 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "POST /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/action" status: 200 len: 32 microversion: 2.1 time: 0.205338 Oct 04 08:58:34.854860 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 340/719] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Oct 4 08:58:34 2022] POST /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/action => generated 32 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:58:34.866097 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-23dd35d8-a4d4-47aa-a04a-4500213c7ad9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:34.867047 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-23dd35d8-a4d4-47aa-a04a-4500213c7ad9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:34.870343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Flavor limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:58:34.871228 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Image limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:58:34.871734 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Flavor pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:58:34.872202 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Image pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:58:34.872636 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:58:34.874031 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-23dd35d8-a4d4-47aa-a04a-4500213c7ad9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:34.874523 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-23dd35d8-a4d4-47aa-a04a-4500213c7ad9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:34.875038 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-23dd35d8-a4d4-47aa-a04a-4500213c7ad9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:34.875787 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-23dd35d8-a4d4-47aa-a04a-4500213c7ad9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:34.876498 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-23dd35d8-a4d4-47aa-a04a-4500213c7ad9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:34.876997 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-23dd35d8-a4d4-47aa-a04a-4500213c7ad9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:34.882075 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:34.882533 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:34.882959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:34.883673 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:34.884143 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:34.884556 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:34.901736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Getting quotas for project 62a1577879c64dc6aac3d5fd4d7ad637. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:58:34.905632 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Getting quotas for user 3fb4f49a5be0475889369e13c3bc1481 and project 62a1577879c64dc6aac3d5fd4d7ad637. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:58:34.916610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Going to run 1 instances... {{(pid=142438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:58:34.919105 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='697e896d-e9a4-41b2-976d-21b912375104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:58:34.977328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-24ea71c8-a637-4579-a928-f80052dc1376 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639631 Oct 04 08:58:34.984086 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 380/720] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 08:58:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:58:34.993925 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b06b97dd-173a-450a-b25c-312fd92c0cc3 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:34.994606 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b06b97dd-173a-450a-b25c-312fd92c0cc3 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:35.042469 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-23dd35d8-a4d4-47aa-a04a-4500213c7ad9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:35.052767 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-23dd35d8-a4d4-47aa-a04a-4500213c7ad9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.191301 Oct 04 08:58:35.053822 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 341/721] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:34 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:35.070644 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b06b97dd-173a-450a-b25c-312fd92c0cc3 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:35.083157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b06b97dd-173a-450a-b25c-312fd92c0cc3 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1258 microversion: 2.1 time: 0.096760 Oct 04 08:58:35.084219 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 381/722] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:34 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1258 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:36.076542 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c09ec4fc-8761-4d8e-9c29-8080a2452bf1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:36.077264 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c09ec4fc-8761-4d8e-9c29-8080a2452bf1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:36.083877 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c09ec4fc-8761-4d8e-9c29-8080a2452bf1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:36.084390 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c09ec4fc-8761-4d8e-9c29-8080a2452bf1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:36.084825 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c09ec4fc-8761-4d8e-9c29-8080a2452bf1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:36.085624 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c09ec4fc-8761-4d8e-9c29-8080a2452bf1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:36.086071 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c09ec4fc-8761-4d8e-9c29-8080a2452bf1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:36.086490 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c09ec4fc-8761-4d8e-9c29-8080a2452bf1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:36.106618 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c0f427b3-2aca-4350-a10f-a9ccb5f5fd2a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:36.107339 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c0f427b3-2aca-4350-a10f-a9ccb5f5fd2a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:36.114773 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0f427b3-2aca-4350-a10f-a9ccb5f5fd2a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:36.115253 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0f427b3-2aca-4350-a10f-a9ccb5f5fd2a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:36.116084 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0f427b3-2aca-4350-a10f-a9ccb5f5fd2a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:36.116781 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0f427b3-2aca-4350-a10f-a9ccb5f5fd2a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:36.117249 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0f427b3-2aca-4350-a10f-a9ccb5f5fd2a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:36.117852 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c0f427b3-2aca-4350-a10f-a9ccb5f5fd2a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:36.198594 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c0f427b3-2aca-4350-a10f-a9ccb5f5fd2a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:36.206714 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c0f427b3-2aca-4350-a10f-a9ccb5f5fd2a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1310 microversion: 2.1 time: 0.104505 Oct 04 08:58:36.207247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 382/723] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:36 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1310 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:36.237314 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c09ec4fc-8761-4d8e-9c29-8080a2452bf1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:36.246142 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c09ec4fc-8761-4d8e-9c29-8080a2452bf1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.173439 Oct 04 08:58:36.246728 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 342/724] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:36 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:37.230996 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-67fda188-6578-4127-9fef-427f57c310f8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:37.231688 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-67fda188-6578-4127-9fef-427f57c310f8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:37.238978 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67fda188-6578-4127-9fef-427f57c310f8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:37.239456 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67fda188-6578-4127-9fef-427f57c310f8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:37.240171 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67fda188-6578-4127-9fef-427f57c310f8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:37.241776 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67fda188-6578-4127-9fef-427f57c310f8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:37.242515 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67fda188-6578-4127-9fef-427f57c310f8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:37.243230 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67fda188-6578-4127-9fef-427f57c310f8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:37.270635 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e64b2f2e-0201-42cb-ae79-46423e4d5f96 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:37.271497 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e64b2f2e-0201-42cb-ae79-46423e4d5f96 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:37.287425 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e64b2f2e-0201-42cb-ae79-46423e4d5f96 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:37.289405 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e64b2f2e-0201-42cb-ae79-46423e4d5f96 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:37.291166 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e64b2f2e-0201-42cb-ae79-46423e4d5f96 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:37.302744 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e64b2f2e-0201-42cb-ae79-46423e4d5f96 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:37.307093 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e64b2f2e-0201-42cb-ae79-46423e4d5f96 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:37.307755 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e64b2f2e-0201-42cb-ae79-46423e4d5f96 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:37.496921 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-67fda188-6578-4127-9fef-427f57c310f8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:37.507735 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-67fda188-6578-4127-9fef-427f57c310f8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.281574 Oct 04 08:58:37.508569 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 383/725] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:37 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:37.606716 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e64b2f2e-0201-42cb-ae79-46423e4d5f96 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:37.615184 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e64b2f2e-0201-42cb-ae79-46423e4d5f96 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.349444 Oct 04 08:58:37.616114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 343/726] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:37 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:38.534254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0965a688-31b6-4466-b6e4-0a849546eee5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:38.534894 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0965a688-31b6-4466-b6e4-0a849546eee5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:38.543113 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0965a688-31b6-4466-b6e4-0a849546eee5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:38.543599 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0965a688-31b6-4466-b6e4-0a849546eee5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:38.544035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0965a688-31b6-4466-b6e4-0a849546eee5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:38.544741 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0965a688-31b6-4466-b6e4-0a849546eee5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:38.545193 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0965a688-31b6-4466-b6e4-0a849546eee5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:38.545635 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0965a688-31b6-4466-b6e4-0a849546eee5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:38.641151 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f6126061-ac06-4422-b9c6-83c1444ee76a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:38.642685 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f6126061-ac06-4422-b9c6-83c1444ee76a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:38.652283 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6126061-ac06-4422-b9c6-83c1444ee76a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:38.653225 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6126061-ac06-4422-b9c6-83c1444ee76a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:38.653888 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6126061-ac06-4422-b9c6-83c1444ee76a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:38.654689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6126061-ac06-4422-b9c6-83c1444ee76a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:38.655234 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6126061-ac06-4422-b9c6-83c1444ee76a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:38.655923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f6126061-ac06-4422-b9c6-83c1444ee76a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:38.733841 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0965a688-31b6-4466-b6e4-0a849546eee5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:38.742001 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0965a688-31b6-4466-b6e4-0a849546eee5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.213446 Oct 04 08:58:38.742588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 384/727] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:38 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:38.802551 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f6126061-ac06-4422-b9c6-83c1444ee76a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:38.813401 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f6126061-ac06-4422-b9c6-83c1444ee76a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.178263 Oct 04 08:58:38.814236 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 344/728] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:38 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:39.766859 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-859b9cc5-a8c6-4b76-9b4b-bfa6b16891df tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:39.767720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-859b9cc5-a8c6-4b76-9b4b-bfa6b16891df tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:39.775308 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-859b9cc5-a8c6-4b76-9b4b-bfa6b16891df tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:39.775792 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-859b9cc5-a8c6-4b76-9b4b-bfa6b16891df tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:39.776253 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-859b9cc5-a8c6-4b76-9b4b-bfa6b16891df tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:39.776944 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-859b9cc5-a8c6-4b76-9b4b-bfa6b16891df tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:39.777394 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-859b9cc5-a8c6-4b76-9b4b-bfa6b16891df tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:39.777809 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-859b9cc5-a8c6-4b76-9b4b-bfa6b16891df tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:39.837335 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-307c8ffa-21c8-47a9-aee8-8a8f5cd482a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:39.838578 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-307c8ffa-21c8-47a9-aee8-8a8f5cd482a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:39.845631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-307c8ffa-21c8-47a9-aee8-8a8f5cd482a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:39.846430 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-307c8ffa-21c8-47a9-aee8-8a8f5cd482a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:39.847100 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-307c8ffa-21c8-47a9-aee8-8a8f5cd482a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:39.848085 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-307c8ffa-21c8-47a9-aee8-8a8f5cd482a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:39.848748 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-307c8ffa-21c8-47a9-aee8-8a8f5cd482a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:39.849420 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-307c8ffa-21c8-47a9-aee8-8a8f5cd482a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:39.965225 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-859b9cc5-a8c6-4b76-9b4b-bfa6b16891df tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:39.976880 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-859b9cc5-a8c6-4b76-9b4b-bfa6b16891df tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.215613 Oct 04 08:58:39.980327 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 385/729] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:39 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:40.011037 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-307c8ffa-21c8-47a9-aee8-8a8f5cd482a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:40.021782 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-307c8ffa-21c8-47a9-aee8-8a8f5cd482a6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.186549 Oct 04 08:58:40.033092 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 345/730] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:39 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:41.001407 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e98c497c-fa2d-45cb-ac4e-7a2e16ec3310 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:41.001986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e98c497c-fa2d-45cb-ac4e-7a2e16ec3310 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:41.009098 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e98c497c-fa2d-45cb-ac4e-7a2e16ec3310 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:41.009578 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e98c497c-fa2d-45cb-ac4e-7a2e16ec3310 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:41.010017 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e98c497c-fa2d-45cb-ac4e-7a2e16ec3310 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:41.010700 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e98c497c-fa2d-45cb-ac4e-7a2e16ec3310 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:41.011149 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e98c497c-fa2d-45cb-ac4e-7a2e16ec3310 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:41.011571 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e98c497c-fa2d-45cb-ac4e-7a2e16ec3310 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:41.045346 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1e2e413b-af9f-4e3e-98a2-64239ba44635 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:41.046193 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1e2e413b-af9f-4e3e-98a2-64239ba44635 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:41.061635 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1e2e413b-af9f-4e3e-98a2-64239ba44635 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:41.062756 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1e2e413b-af9f-4e3e-98a2-64239ba44635 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:41.063413 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1e2e413b-af9f-4e3e-98a2-64239ba44635 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:41.064401 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1e2e413b-af9f-4e3e-98a2-64239ba44635 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:41.065056 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1e2e413b-af9f-4e3e-98a2-64239ba44635 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:41.065700 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1e2e413b-af9f-4e3e-98a2-64239ba44635 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:41.195357 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e98c497c-fa2d-45cb-ac4e-7a2e16ec3310 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:41.202993 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e98c497c-fa2d-45cb-ac4e-7a2e16ec3310 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.205691 Oct 04 08:58:41.203550 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 386/731] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:40 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:41.229336 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1e2e413b-af9f-4e3e-98a2-64239ba44635 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:41.238859 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1e2e413b-af9f-4e3e-98a2-64239ba44635 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.197539 Oct 04 08:58:41.239450 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 346/732] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:41 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:42.232060 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c46cd23f-d1fe-498f-afd3-350f94b4b106 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:42.232952 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c46cd23f-d1fe-498f-afd3-350f94b4b106 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:42.243164 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c46cd23f-d1fe-498f-afd3-350f94b4b106 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:42.243653 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c46cd23f-d1fe-498f-afd3-350f94b4b106 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:42.244153 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c46cd23f-d1fe-498f-afd3-350f94b4b106 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:42.244857 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c46cd23f-d1fe-498f-afd3-350f94b4b106 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:42.257945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c46cd23f-d1fe-498f-afd3-350f94b4b106 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:42.258499 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c46cd23f-d1fe-498f-afd3-350f94b4b106 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:42.262731 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-242813fc-59ef-40fb-b66e-67027a896b16 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:42.263903 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-242813fc-59ef-40fb-b66e-67027a896b16 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:42.271028 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-242813fc-59ef-40fb-b66e-67027a896b16 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:42.275052 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-242813fc-59ef-40fb-b66e-67027a896b16 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:42.275777 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-242813fc-59ef-40fb-b66e-67027a896b16 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:42.276909 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-242813fc-59ef-40fb-b66e-67027a896b16 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:42.277572 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-242813fc-59ef-40fb-b66e-67027a896b16 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:42.278209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-242813fc-59ef-40fb-b66e-67027a896b16 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:42.449181 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c46cd23f-d1fe-498f-afd3-350f94b4b106 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:42.457883 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c46cd23f-d1fe-498f-afd3-350f94b4b106 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.233701 Oct 04 08:58:42.458454 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 387/733] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:42 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:42.470675 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-242813fc-59ef-40fb-b66e-67027a896b16 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:42.479170 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-242813fc-59ef-40fb-b66e-67027a896b16 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.220272 Oct 04 08:58:42.479779 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 347/734] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:42 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:43.481455 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-17a80015-bce0-48a1-8cf5-ab4fd45c6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:43.482057 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-17a80015-bce0-48a1-8cf5-ab4fd45c6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:43.488933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17a80015-bce0-48a1-8cf5-ab4fd45c6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:43.489399 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17a80015-bce0-48a1-8cf5-ab4fd45c6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:43.489985 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17a80015-bce0-48a1-8cf5-ab4fd45c6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:43.491244 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17a80015-bce0-48a1-8cf5-ab4fd45c6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:43.491719 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17a80015-bce0-48a1-8cf5-ab4fd45c6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:43.492247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17a80015-bce0-48a1-8cf5-ab4fd45c6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:43.504646 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-67065912-8845-4c86-a3f3-d287c14796d7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:43.507915 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-67065912-8845-4c86-a3f3-d287c14796d7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:43.512719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-67065912-8845-4c86-a3f3-d287c14796d7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:43.513206 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-67065912-8845-4c86-a3f3-d287c14796d7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:43.513637 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-67065912-8845-4c86-a3f3-d287c14796d7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:43.514364 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-67065912-8845-4c86-a3f3-d287c14796d7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:43.514917 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-67065912-8845-4c86-a3f3-d287c14796d7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:43.515707 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-67065912-8845-4c86-a3f3-d287c14796d7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:43.719619 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-67065912-8845-4c86-a3f3-d287c14796d7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:43.729376 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-17a80015-bce0-48a1-8cf5-ab4fd45c6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:43.740412 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-67065912-8845-4c86-a3f3-d287c14796d7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.239532 Oct 04 08:58:43.741225 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-17a80015-bce0-48a1-8cf5-ab4fd45c6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.260056 Oct 04 08:58:43.742427 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 388/735] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:43 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:43.756852 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 348/736] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:43 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:44.772345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-74be0bf1-97bb-44dd-b1c3-b13e81db34b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:44.773598 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-74be0bf1-97bb-44dd-b1c3-b13e81db34b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:44.775803 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f7a84b3b-de84-4ac7-807a-806f1e4162aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:44.776525 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f7a84b3b-de84-4ac7-807a-806f1e4162aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:44.782300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=4 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:44.784450 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f7a84b3b-de84-4ac7-807a-806f1e4162aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:44.784949 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f7a84b3b-de84-4ac7-807a-806f1e4162aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:44.785957 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f7a84b3b-de84-4ac7-807a-806f1e4162aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:44.787289 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f7a84b3b-de84-4ac7-807a-806f1e4162aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:44.787907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f7a84b3b-de84-4ac7-807a-806f1e4162aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:44.788632 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f7a84b3b-de84-4ac7-807a-806f1e4162aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:44.789022 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-74be0bf1-97bb-44dd-b1c3-b13e81db34b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:44.792925 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-74be0bf1-97bb-44dd-b1c3-b13e81db34b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:44.793365 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-74be0bf1-97bb-44dd-b1c3-b13e81db34b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:44.794187 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-74be0bf1-97bb-44dd-b1c3-b13e81db34b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:44.794614 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-74be0bf1-97bb-44dd-b1c3-b13e81db34b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:44.795198 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-74be0bf1-97bb-44dd-b1c3-b13e81db34b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:44.892953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:44.977081 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f7a84b3b-de84-4ac7-807a-806f1e4162aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:44.985200 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f7a84b3b-de84-4ac7-807a-806f1e4162aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.214050 Oct 04 08:58:44.986410 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 349/737] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:44 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:45.017725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-74be0bf1-97bb-44dd-b1c3-b13e81db34b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:45.026474 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-74be0bf1-97bb-44dd-b1c3-b13e81db34b8 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.261544 Oct 04 08:58:45.027126 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 389/738] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:44 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:46.012674 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a6ba6f13-8509-438e-8c57-5f194d464c53 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:46.013501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a6ba6f13-8509-438e-8c57-5f194d464c53 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:46.022368 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a6ba6f13-8509-438e-8c57-5f194d464c53 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:46.022978 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a6ba6f13-8509-438e-8c57-5f194d464c53 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:46.023580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a6ba6f13-8509-438e-8c57-5f194d464c53 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:46.024657 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a6ba6f13-8509-438e-8c57-5f194d464c53 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:46.025100 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a6ba6f13-8509-438e-8c57-5f194d464c53 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:46.025777 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a6ba6f13-8509-438e-8c57-5f194d464c53 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:46.050220 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-344331ca-eb29-4900-892e-a14c18a4ef8e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:46.050916 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-344331ca-eb29-4900-892e-a14c18a4ef8e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:46.053216 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=8 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:46.059358 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-344331ca-eb29-4900-892e-a14c18a4ef8e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:46.059945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-344331ca-eb29-4900-892e-a14c18a4ef8e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:46.060503 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-344331ca-eb29-4900-892e-a14c18a4ef8e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:46.061571 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-344331ca-eb29-4900-892e-a14c18a4ef8e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:46.062134 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-344331ca-eb29-4900-892e-a14c18a4ef8e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:46.062698 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-344331ca-eb29-4900-892e-a14c18a4ef8e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:46.214768 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a6ba6f13-8509-438e-8c57-5f194d464c53 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:46.224199 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a6ba6f13-8509-438e-8c57-5f194d464c53 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.217128 Oct 04 08:58:46.225103 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 350/739] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:46 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:46.246602 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-344331ca-eb29-4900-892e-a14c18a4ef8e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:46.255308 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-344331ca-eb29-4900-892e-a14c18a4ef8e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.209037 Oct 04 08:58:46.255997 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 390/740] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:46 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:47.063163 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-68d0980f-50d1-445a-86fb-269eca81fe1f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:47.063763 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-68d0980f-50d1-445a-86fb-269eca81fe1f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:47.070696 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-68d0980f-50d1-445a-86fb-269eca81fe1f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.071203 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-68d0980f-50d1-445a-86fb-269eca81fe1f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.071609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-68d0980f-50d1-445a-86fb-269eca81fe1f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.072649 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-68d0980f-50d1-445a-86fb-269eca81fe1f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.073353 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-68d0980f-50d1-445a-86fb-269eca81fe1f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.074022 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-68d0980f-50d1-445a-86fb-269eca81fe1f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.106869 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-68d0980f-50d1-445a-86fb-269eca81fe1f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments/b621a97d-ecfc-4b91-9e90-048f48b7794f" status: 200 len: 194 microversion: 2.20 time: 0.047695 Oct 04 08:58:47.107440 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 351/741] 10.222.0.44 () {60 vars in 1454 bytes} [Tue Oct 4 08:58:47 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments/b621a97d-ecfc-4b91-9e90-048f48b7794f => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:58:47.177693 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-36c2ebc0-1e83-40c4-85cf-029e70e9b0da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:47.178298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-36c2ebc0-1e83-40c4-85cf-029e70e9b0da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:47.184639 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-36c2ebc0-1e83-40c4-85cf-029e70e9b0da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.185116 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-36c2ebc0-1e83-40c4-85cf-029e70e9b0da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.185547 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-36c2ebc0-1e83-40c4-85cf-029e70e9b0da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.186238 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-36c2ebc0-1e83-40c4-85cf-029e70e9b0da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.186685 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-36c2ebc0-1e83-40c4-85cf-029e70e9b0da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.187099 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-36c2ebc0-1e83-40c4-85cf-029e70e9b0da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.247646 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5c65d58e-0038-4f6b-9a9a-2fbb0bf4b015 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:47.248213 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5c65d58e-0038-4f6b-9a9a-2fbb0bf4b015 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:47.254505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5c65d58e-0038-4f6b-9a9a-2fbb0bf4b015 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.255090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5c65d58e-0038-4f6b-9a9a-2fbb0bf4b015 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.255524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5c65d58e-0038-4f6b-9a9a-2fbb0bf4b015 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.257069 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5c65d58e-0038-4f6b-9a9a-2fbb0bf4b015 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.257851 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5c65d58e-0038-4f6b-9a9a-2fbb0bf4b015 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.258515 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5c65d58e-0038-4f6b-9a9a-2fbb0bf4b015 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.321201 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-36c2ebc0-1e83-40c4-85cf-029e70e9b0da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lazy-loading 'services' on Instance uuid f4454abc-67a9-470b-bdce-5a69bc51bbed {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:58:47.395296 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5c65d58e-0038-4f6b-9a9a-2fbb0bf4b015 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:47.403288 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5c65d58e-0038-4f6b-9a9a-2fbb0bf4b015 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.159546 Oct 04 08:58:47.403858 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 352/742] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:47 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:47.408445 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b3783d61-a516-40b8-9f5d-fd818be2b996 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:47.409177 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b3783d61-a516-40b8-9f5d-fd818be2b996 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:47.414915 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b3783d61-a516-40b8-9f5d-fd818be2b996 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.415403 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b3783d61-a516-40b8-9f5d-fd818be2b996 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.415849 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b3783d61-a516-40b8-9f5d-fd818be2b996 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.416571 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b3783d61-a516-40b8-9f5d-fd818be2b996 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.417031 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b3783d61-a516-40b8-9f5d-fd818be2b996 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.417451 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b3783d61-a516-40b8-9f5d-fd818be2b996 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.451071 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-36c2ebc0-1e83-40c4-85cf-029e70e9b0da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments/b621a97d-ecfc-4b91-9e90-048f48b7794f" status: 202 len: 0 microversion: 2.20 time: 0.277385 Oct 04 08:58:47.451667 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 391/743] 10.222.0.44 () {60 vars in 1457 bytes} [Tue Oct 4 08:58:47 2022] DELETE /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments/b621a97d-ecfc-4b91-9e90-048f48b7794f => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:58:47.460372 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-67deadea-fd21-4f44-b6f7-b8356e758de2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:47.462667 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-67deadea-fd21-4f44-b6f7-b8356e758de2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:47.468842 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67deadea-fd21-4f44-b6f7-b8356e758de2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.469320 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67deadea-fd21-4f44-b6f7-b8356e758de2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.469745 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67deadea-fd21-4f44-b6f7-b8356e758de2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.470593 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67deadea-fd21-4f44-b6f7-b8356e758de2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.471038 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67deadea-fd21-4f44-b6f7-b8356e758de2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.471451 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67deadea-fd21-4f44-b6f7-b8356e758de2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.501321 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-67deadea-fd21-4f44-b6f7-b8356e758de2 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045176 Oct 04 08:58:47.501893 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 392/744] 10.222.0.44 () {60 vars in 1343 bytes} [Tue Oct 4 08:58:47 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 08:58:47.550652 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b3783d61-a516-40b8-9f5d-fd818be2b996 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:47.561300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b3783d61-a516-40b8-9f5d-fd818be2b996 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.156267 Oct 04 08:58:47.561884 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 353/745] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:47 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:48.430251 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b8c4e33e-a013-4cc2-bd19-a8436b0a1ee0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:48.430955 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b8c4e33e-a013-4cc2-bd19-a8436b0a1ee0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:48.438827 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8c4e33e-a013-4cc2-bd19-a8436b0a1ee0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:48.439386 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8c4e33e-a013-4cc2-bd19-a8436b0a1ee0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:48.439907 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8c4e33e-a013-4cc2-bd19-a8436b0a1ee0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:48.440724 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8c4e33e-a013-4cc2-bd19-a8436b0a1ee0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:48.441245 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8c4e33e-a013-4cc2-bd19-a8436b0a1ee0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:48.441728 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b8c4e33e-a013-4cc2-bd19-a8436b0a1ee0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:48.515514 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1eb7b8c6-5f4c-4b54-a630-5d5fb9b4b59e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:48.518048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1eb7b8c6-5f4c-4b54-a630-5d5fb9b4b59e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:48.524963 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1eb7b8c6-5f4c-4b54-a630-5d5fb9b4b59e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:48.525453 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1eb7b8c6-5f4c-4b54-a630-5d5fb9b4b59e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:48.526255 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1eb7b8c6-5f4c-4b54-a630-5d5fb9b4b59e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:48.526598 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1eb7b8c6-5f4c-4b54-a630-5d5fb9b4b59e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:48.527064 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1eb7b8c6-5f4c-4b54-a630-5d5fb9b4b59e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:48.527491 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1eb7b8c6-5f4c-4b54-a630-5d5fb9b4b59e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:48.544690 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:48.560631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1eb7b8c6-5f4c-4b54-a630-5d5fb9b4b59e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049751 Oct 04 08:58:48.561207 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 354/746] 10.222.0.44 () {60 vars in 1343 bytes} [Tue Oct 4 08:58:48 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:58:48.577293 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b8c4e33e-a013-4cc2-bd19-a8436b0a1ee0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:48.583999 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e5167f1a-087d-4a8e-8ff0-ef809968a7e7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:48.584643 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e5167f1a-087d-4a8e-8ff0-ef809968a7e7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:48.587914 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b8c4e33e-a013-4cc2-bd19-a8436b0a1ee0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.164169 Oct 04 08:58:48.588507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 393/747] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:48 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:48.590920 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e5167f1a-087d-4a8e-8ff0-ef809968a7e7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:48.591482 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e5167f1a-087d-4a8e-8ff0-ef809968a7e7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:48.592019 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e5167f1a-087d-4a8e-8ff0-ef809968a7e7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:48.592829 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e5167f1a-087d-4a8e-8ff0-ef809968a7e7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:48.593704 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e5167f1a-087d-4a8e-8ff0-ef809968a7e7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:48.594204 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e5167f1a-087d-4a8e-8ff0-ef809968a7e7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:48.741079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e5167f1a-087d-4a8e-8ff0-ef809968a7e7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:48.749966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e5167f1a-087d-4a8e-8ff0-ef809968a7e7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.170023 Oct 04 08:58:48.750644 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 355/748] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:48 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:49.577136 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-46c8affe-6eb4-4fa3-8fea-4678716c6c76 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:49.580740 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-46c8affe-6eb4-4fa3-8fea-4678716c6c76 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:49.590136 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-46c8affe-6eb4-4fa3-8fea-4678716c6c76 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:49.590616 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-46c8affe-6eb4-4fa3-8fea-4678716c6c76 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:49.591047 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-46c8affe-6eb4-4fa3-8fea-4678716c6c76 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:49.591717 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-46c8affe-6eb4-4fa3-8fea-4678716c6c76 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:49.592218 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-46c8affe-6eb4-4fa3-8fea-4678716c6c76 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:49.592634 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-46c8affe-6eb4-4fa3-8fea-4678716c6c76 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:49.611702 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-374f9471-f61f-4271-bf4e-2cd1a014fdfc tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:49.612348 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-374f9471-f61f-4271-bf4e-2cd1a014fdfc tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:49.619084 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-374f9471-f61f-4271-bf4e-2cd1a014fdfc tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:49.619728 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-374f9471-f61f-4271-bf4e-2cd1a014fdfc tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:49.620208 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-374f9471-f61f-4271-bf4e-2cd1a014fdfc tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:49.620896 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-374f9471-f61f-4271-bf4e-2cd1a014fdfc tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:49.621350 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-374f9471-f61f-4271-bf4e-2cd1a014fdfc tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:49.621769 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-374f9471-f61f-4271-bf4e-2cd1a014fdfc tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:49.625088 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-46c8affe-6eb4-4fa3-8fea-4678716c6c76 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054609 Oct 04 08:58:49.625660 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 394/749] 10.222.0.44 () {60 vars in 1343 bytes} [Tue Oct 4 08:58:49 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:58:49.756765 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-374f9471-f61f-4271-bf4e-2cd1a014fdfc tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:49.765038 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-374f9471-f61f-4271-bf4e-2cd1a014fdfc tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.157239 Oct 04 08:58:49.765605 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 356/750] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:49 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:49.773647 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ac41b2b8-e98e-4f44-9f14-bab3693693d2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:49.774335 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ac41b2b8-e98e-4f44-9f14-bab3693693d2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:49.780679 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac41b2b8-e98e-4f44-9f14-bab3693693d2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:49.781159 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac41b2b8-e98e-4f44-9f14-bab3693693d2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:49.781713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac41b2b8-e98e-4f44-9f14-bab3693693d2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:49.782400 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac41b2b8-e98e-4f44-9f14-bab3693693d2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:49.782846 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac41b2b8-e98e-4f44-9f14-bab3693693d2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:49.783262 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ac41b2b8-e98e-4f44-9f14-bab3693693d2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:49.787306 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:49.910963 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ac41b2b8-e98e-4f44-9f14-bab3693693d2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:49.919923 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ac41b2b8-e98e-4f44-9f14-bab3693693d2 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.150131 Oct 04 08:58:49.920536 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 395/751] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:49 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:50.639569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4b372ad5-120d-431e-b573-81d81972d6eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:50.641859 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4b372ad5-120d-431e-b573-81d81972d6eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:50.648826 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b372ad5-120d-431e-b573-81d81972d6eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:50.649309 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b372ad5-120d-431e-b573-81d81972d6eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:50.649755 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b372ad5-120d-431e-b573-81d81972d6eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:50.650450 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b372ad5-120d-431e-b573-81d81972d6eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:50.650907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b372ad5-120d-431e-b573-81d81972d6eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:50.651330 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b372ad5-120d-431e-b573-81d81972d6eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:50.680831 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4b372ad5-120d-431e-b573-81d81972d6eb tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045347 Oct 04 08:58:50.681307 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 357/752] 10.222.0.44 () {60 vars in 1343 bytes} [Tue Oct 4 08:58:50 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:58:50.791680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4ee6fe79-1a34-492b-92d4-ddfff65bc0ea tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:50.792675 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4ee6fe79-1a34-492b-92d4-ddfff65bc0ea tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:50.803541 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4ee6fe79-1a34-492b-92d4-ddfff65bc0ea tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:50.804396 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4ee6fe79-1a34-492b-92d4-ddfff65bc0ea tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:50.805148 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4ee6fe79-1a34-492b-92d4-ddfff65bc0ea tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:50.806321 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4ee6fe79-1a34-492b-92d4-ddfff65bc0ea tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:50.806801 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4ee6fe79-1a34-492b-92d4-ddfff65bc0ea tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:50.807220 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4ee6fe79-1a34-492b-92d4-ddfff65bc0ea tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:50.943542 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9b0f8332-bd6f-4614-a3ae-dfda16f526a5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:50.944131 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9b0f8332-bd6f-4614-a3ae-dfda16f526a5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:50.948883 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4ee6fe79-1a34-492b-92d4-ddfff65bc0ea tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:50.950178 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b0f8332-bd6f-4614-a3ae-dfda16f526a5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:50.950673 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b0f8332-bd6f-4614-a3ae-dfda16f526a5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:50.951107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b0f8332-bd6f-4614-a3ae-dfda16f526a5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:50.952389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b0f8332-bd6f-4614-a3ae-dfda16f526a5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:50.952864 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b0f8332-bd6f-4614-a3ae-dfda16f526a5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:50.953617 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b0f8332-bd6f-4614-a3ae-dfda16f526a5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:50.959738 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4ee6fe79-1a34-492b-92d4-ddfff65bc0ea tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.174485 Oct 04 08:58:50.960537 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 396/753] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:50 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:51.091870 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9b0f8332-bd6f-4614-a3ae-dfda16f526a5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:51.100632 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9b0f8332-bd6f-4614-a3ae-dfda16f526a5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.161202 Oct 04 08:58:51.101188 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 358/754] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:50 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:51.695341 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0f5998c7-f8da-467d-991a-55a89ff96a22 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:51.697892 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0f5998c7-f8da-467d-991a-55a89ff96a22 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:51.704356 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0f5998c7-f8da-467d-991a-55a89ff96a22 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:51.704836 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0f5998c7-f8da-467d-991a-55a89ff96a22 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:51.705260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0f5998c7-f8da-467d-991a-55a89ff96a22 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:51.705951 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0f5998c7-f8da-467d-991a-55a89ff96a22 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:51.706413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0f5998c7-f8da-467d-991a-55a89ff96a22 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:51.706821 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0f5998c7-f8da-467d-991a-55a89ff96a22 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:51.737207 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0f5998c7-f8da-467d-991a-55a89ff96a22 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046225 Oct 04 08:58:51.737776 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 397/755] 10.222.0.44 () {60 vars in 1343 bytes} [Tue Oct 4 08:58:51 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:58:51.882119 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-64f8a734-c3aa-4c42-baab-969e32bcd238 req-5303bdcc-a038-4201-9a78-eba652f09819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5d6881-b38b-43b8-91c1-84e3e1338d9f", "tag": "7964acdb-66e8-472d-b77c-526ae4282bc9"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:51.892137 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-64f8a734-c3aa-4c42-baab-969e32bcd238 req-5303bdcc-a038-4201-9a78-eba652f09819 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:51.892616 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-64f8a734-c3aa-4c42-baab-969e32bcd238 req-5303bdcc-a038-4201-9a78-eba652f09819 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:51.893041 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-64f8a734-c3aa-4c42-baab-969e32bcd238 req-5303bdcc-a038-4201-9a78-eba652f09819 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:51.906137 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-64f8a734-c3aa-4c42-baab-969e32bcd238 req-5303bdcc-a038-4201-9a78-eba652f09819 service nova] Creating event network-changed:7964acdb-66e8-472d-b77c-526ae4282bc9 for instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f on hv-cinder-84456 Oct 04 08:58:51.911531 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-64f8a734-c3aa-4c42-baab-969e32bcd238 req-5303bdcc-a038-4201-9a78-eba652f09819 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101872 Oct 04 08:58:51.912560 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 359/756] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:51.985496 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-115c7fe4-fbbc-40e2-b26d-72dcc1bac76d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:51.986506 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-115c7fe4-fbbc-40e2-b26d-72dcc1bac76d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:51.996301 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-115c7fe4-fbbc-40e2-b26d-72dcc1bac76d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:51.996785 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-115c7fe4-fbbc-40e2-b26d-72dcc1bac76d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:51.997211 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-115c7fe4-fbbc-40e2-b26d-72dcc1bac76d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:51.997978 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-115c7fe4-fbbc-40e2-b26d-72dcc1bac76d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:51.998420 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-115c7fe4-fbbc-40e2-b26d-72dcc1bac76d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:51.998833 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-115c7fe4-fbbc-40e2-b26d-72dcc1bac76d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:52.125502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fa8cc2a5-8630-4e33-8e91-337fbddcbfa7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:52.126228 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-fa8cc2a5-8630-4e33-8e91-337fbddcbfa7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:52.132319 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fa8cc2a5-8630-4e33-8e91-337fbddcbfa7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:52.132793 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fa8cc2a5-8630-4e33-8e91-337fbddcbfa7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:52.133221 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fa8cc2a5-8630-4e33-8e91-337fbddcbfa7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:52.133908 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fa8cc2a5-8630-4e33-8e91-337fbddcbfa7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:52.134350 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fa8cc2a5-8630-4e33-8e91-337fbddcbfa7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:52.134767 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fa8cc2a5-8630-4e33-8e91-337fbddcbfa7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:52.189227 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-115c7fe4-fbbc-40e2-b26d-72dcc1bac76d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:52.197157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-115c7fe4-fbbc-40e2-b26d-72dcc1bac76d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.218340 Oct 04 08:58:52.197948 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 398/757] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:51 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:52.271633 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-fa8cc2a5-8630-4e33-8e91-337fbddcbfa7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:52.281077 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fa8cc2a5-8630-4e33-8e91-337fbddcbfa7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.159943 Oct 04 08:58:52.281627 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 360/758] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:52 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:52.753708 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1e0b42a9-2fb8-4e59-ba37-a9d32be6ba11 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:52.756787 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1e0b42a9-2fb8-4e59-ba37-a9d32be6ba11 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:52.764319 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1e0b42a9-2fb8-4e59-ba37-a9d32be6ba11 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:52.764801 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1e0b42a9-2fb8-4e59-ba37-a9d32be6ba11 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:52.765232 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1e0b42a9-2fb8-4e59-ba37-a9d32be6ba11 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:52.765930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1e0b42a9-2fb8-4e59-ba37-a9d32be6ba11 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:52.766369 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1e0b42a9-2fb8-4e59-ba37-a9d32be6ba11 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:52.766794 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1e0b42a9-2fb8-4e59-ba37-a9d32be6ba11 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:52.796152 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1e0b42a9-2fb8-4e59-ba37-a9d32be6ba11 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048308 Oct 04 08:58:52.796719 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 399/759] 10.222.0.44 () {60 vars in 1343 bytes} [Tue Oct 4 08:58:52 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:58:53.224588 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-087e3533-680b-4dd2-88f4-3b0bb1f2c67b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:53.225645 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-087e3533-680b-4dd2-88f4-3b0bb1f2c67b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:53.236557 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-087e3533-680b-4dd2-88f4-3b0bb1f2c67b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:53.237351 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-087e3533-680b-4dd2-88f4-3b0bb1f2c67b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:53.238066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-087e3533-680b-4dd2-88f4-3b0bb1f2c67b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:53.239202 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-087e3533-680b-4dd2-88f4-3b0bb1f2c67b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:53.239972 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-087e3533-680b-4dd2-88f4-3b0bb1f2c67b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:53.240705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-087e3533-680b-4dd2-88f4-3b0bb1f2c67b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:53.306734 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f31b3776-295f-49eb-8790-cc6b5f0d67e4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:53.307445 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f31b3776-295f-49eb-8790-cc6b5f0d67e4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:53.313919 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f31b3776-295f-49eb-8790-cc6b5f0d67e4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:53.314401 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f31b3776-295f-49eb-8790-cc6b5f0d67e4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:53.314826 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f31b3776-295f-49eb-8790-cc6b5f0d67e4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:53.315511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f31b3776-295f-49eb-8790-cc6b5f0d67e4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:53.316050 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f31b3776-295f-49eb-8790-cc6b5f0d67e4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:53.316472 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f31b3776-295f-49eb-8790-cc6b5f0d67e4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:53.398697 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-087e3533-680b-4dd2-88f4-3b0bb1f2c67b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:53.407153 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-087e3533-680b-4dd2-88f4-3b0bb1f2c67b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.188910 Oct 04 08:58:53.407620 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 361/760] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:53 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:53.460551 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f31b3776-295f-49eb-8790-cc6b5f0d67e4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:53.468914 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f31b3776-295f-49eb-8790-cc6b5f0d67e4 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.166072 Oct 04 08:58:53.469516 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 400/761] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:53 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:53.809392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-eed879be-fe25-4987-8ab6-a3f4caf9552c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:53.811841 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-eed879be-fe25-4987-8ab6-a3f4caf9552c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:53.819663 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-eed879be-fe25-4987-8ab6-a3f4caf9552c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:53.820187 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-eed879be-fe25-4987-8ab6-a3f4caf9552c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:53.820655 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-eed879be-fe25-4987-8ab6-a3f4caf9552c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:53.821358 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-eed879be-fe25-4987-8ab6-a3f4caf9552c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:53.821808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-eed879be-fe25-4987-8ab6-a3f4caf9552c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:53.822335 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-eed879be-fe25-4987-8ab6-a3f4caf9552c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:53.855382 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-eed879be-fe25-4987-8ab6-a3f4caf9552c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050216 Oct 04 08:58:53.856206 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 362/762] 10.222.0.44 () {60 vars in 1343 bytes} [Tue Oct 4 08:58:53 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:53.923777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-336ddd8f-5030-4546-9647-3aa7e79b1e8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:53.924353 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-336ddd8f-5030-4546-9647-3aa7e79b1e8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:53.930457 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-336ddd8f-5030-4546-9647-3aa7e79b1e8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:53.930926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-336ddd8f-5030-4546-9647-3aa7e79b1e8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:53.931348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-336ddd8f-5030-4546-9647-3aa7e79b1e8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:53.932092 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-336ddd8f-5030-4546-9647-3aa7e79b1e8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:53.932686 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-336ddd8f-5030-4546-9647-3aa7e79b1e8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:53.933096 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-336ddd8f-5030-4546-9647-3aa7e79b1e8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:53.958276 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-336ddd8f-5030-4546-9647-3aa7e79b1e8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Going to try to terminate instance {{(pid=142438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:58:54.045271 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-336ddd8f-5030-4546-9647-3aa7e79b1e8f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 204 len: 0 microversion: 2.20 time: 0.126254 Oct 04 08:58:54.045882 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 401/763] 10.222.0.44 () {60 vars in 1280 bytes} [Tue Oct 4 08:58:53 2022] DELETE /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 08:58:54.057519 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9a4dfd8e-4ac7-48f2-b96b-a652e230bac4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:54.058124 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9a4dfd8e-4ac7-48f2-b96b-a652e230bac4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:54.064624 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a4dfd8e-4ac7-48f2-b96b-a652e230bac4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:54.065103 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a4dfd8e-4ac7-48f2-b96b-a652e230bac4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:54.065533 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a4dfd8e-4ac7-48f2-b96b-a652e230bac4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:54.066217 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a4dfd8e-4ac7-48f2-b96b-a652e230bac4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:54.066652 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a4dfd8e-4ac7-48f2-b96b-a652e230bac4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:54.067066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a4dfd8e-4ac7-48f2-b96b-a652e230bac4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:54.194270 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9a4dfd8e-4ac7-48f2-b96b-a652e230bac4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:54.205614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9a4dfd8e-4ac7-48f2-b96b-a652e230bac4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:54.207965 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9a4dfd8e-4ac7-48f2-b96b-a652e230bac4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:54.209452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9a4dfd8e-4ac7-48f2-b96b-a652e230bac4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.157439 Oct 04 08:58:54.210168 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 363/764] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:54 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:54.431503 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-68103f5e-8211-4bb1-9ddd-1568955dd165 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:54.432084 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-68103f5e-8211-4bb1-9ddd-1568955dd165 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:54.438835 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-68103f5e-8211-4bb1-9ddd-1568955dd165 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:54.439320 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-68103f5e-8211-4bb1-9ddd-1568955dd165 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:54.439755 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-68103f5e-8211-4bb1-9ddd-1568955dd165 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:54.440477 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-68103f5e-8211-4bb1-9ddd-1568955dd165 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:54.440932 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-68103f5e-8211-4bb1-9ddd-1568955dd165 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:54.441360 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-68103f5e-8211-4bb1-9ddd-1568955dd165 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:54.493048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-24f7ff05-33ae-4dde-9525-3b5cefa8300e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:54.493620 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-24f7ff05-33ae-4dde-9525-3b5cefa8300e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:54.500505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-24f7ff05-33ae-4dde-9525-3b5cefa8300e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:54.500991 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-24f7ff05-33ae-4dde-9525-3b5cefa8300e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:54.501427 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-24f7ff05-33ae-4dde-9525-3b5cefa8300e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:54.502115 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-24f7ff05-33ae-4dde-9525-3b5cefa8300e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:54.502572 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-24f7ff05-33ae-4dde-9525-3b5cefa8300e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:54.502989 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-24f7ff05-33ae-4dde-9525-3b5cefa8300e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:54.615001 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-68103f5e-8211-4bb1-9ddd-1568955dd165 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:54.624254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-68103f5e-8211-4bb1-9ddd-1568955dd165 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.197079 Oct 04 08:58:54.624813 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 402/765] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:54 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:54.660678 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-24f7ff05-33ae-4dde-9525-3b5cefa8300e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:54.670115 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-24f7ff05-33ae-4dde-9525-3b5cefa8300e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.181380 Oct 04 08:58:54.670691 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 364/766] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:54 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:55.247243 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-86d9c2f1-340c-45e0-a63b-bd267140e869 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:55.247986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-86d9c2f1-340c-45e0-a63b-bd267140e869 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:55.254108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-86d9c2f1-340c-45e0-a63b-bd267140e869 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:55.254589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-86d9c2f1-340c-45e0-a63b-bd267140e869 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:55.255012 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-86d9c2f1-340c-45e0-a63b-bd267140e869 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:55.255696 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-86d9c2f1-340c-45e0-a63b-bd267140e869 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:55.256168 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-86d9c2f1-340c-45e0-a63b-bd267140e869 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:55.256584 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-86d9c2f1-340c-45e0-a63b-bd267140e869 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:55.391077 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-86d9c2f1-340c-45e0-a63b-bd267140e869 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:55.399500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-86d9c2f1-340c-45e0-a63b-bd267140e869 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:55.400960 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-86d9c2f1-340c-45e0-a63b-bd267140e869 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:55.402232 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-86d9c2f1-340c-45e0-a63b-bd267140e869 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.163454 Oct 04 08:58:55.403135 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 403/767] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:55 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:55.646920 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6f68b4ba-fa23-4622-8b1c-bef8cb2d6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:55.647541 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6f68b4ba-fa23-4622-8b1c-bef8cb2d6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:55.654662 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6f68b4ba-fa23-4622-8b1c-bef8cb2d6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:55.655152 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6f68b4ba-fa23-4622-8b1c-bef8cb2d6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:55.655587 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6f68b4ba-fa23-4622-8b1c-bef8cb2d6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:55.656337 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6f68b4ba-fa23-4622-8b1c-bef8cb2d6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:55.656793 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6f68b4ba-fa23-4622-8b1c-bef8cb2d6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:55.657221 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6f68b4ba-fa23-4622-8b1c-bef8cb2d6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:55.693827 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-baed3b58-3f6d-4874-ae31-e96e01783e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:55.694516 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-baed3b58-3f6d-4874-ae31-e96e01783e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:55.702045 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-baed3b58-3f6d-4874-ae31-e96e01783e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:55.702622 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-baed3b58-3f6d-4874-ae31-e96e01783e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:55.703147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-baed3b58-3f6d-4874-ae31-e96e01783e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:55.703917 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-baed3b58-3f6d-4874-ae31-e96e01783e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:55.704464 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-baed3b58-3f6d-4874-ae31-e96e01783e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:55.704955 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-baed3b58-3f6d-4874-ae31-e96e01783e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:55.831514 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6f68b4ba-fa23-4622-8b1c-bef8cb2d6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:55.839676 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6f68b4ba-fa23-4622-8b1c-bef8cb2d6425 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.196703 Oct 04 08:58:55.840504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 365/768] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:55 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:55.865149 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-baed3b58-3f6d-4874-ae31-e96e01783e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:55.877954 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-baed3b58-3f6d-4874-ae31-e96e01783e3d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.187735 Oct 04 08:58:55.878735 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 404/769] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:55 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:56.433960 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-322efaae-4b22-456b-8b04-00c8cdd7f7f8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:56.434961 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-322efaae-4b22-456b-8b04-00c8cdd7f7f8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:56.445398 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-322efaae-4b22-456b-8b04-00c8cdd7f7f8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:56.446198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-322efaae-4b22-456b-8b04-00c8cdd7f7f8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:56.446974 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-322efaae-4b22-456b-8b04-00c8cdd7f7f8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:56.448256 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-322efaae-4b22-456b-8b04-00c8cdd7f7f8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:56.448710 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-322efaae-4b22-456b-8b04-00c8cdd7f7f8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:56.449132 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-322efaae-4b22-456b-8b04-00c8cdd7f7f8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:56.582670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-322efaae-4b22-456b-8b04-00c8cdd7f7f8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:56.591273 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-322efaae-4b22-456b-8b04-00c8cdd7f7f8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:56.592736 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-322efaae-4b22-456b-8b04-00c8cdd7f7f8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:56.593880 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-322efaae-4b22-456b-8b04-00c8cdd7f7f8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.167670 Oct 04 08:58:56.594447 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 366/770] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:56 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:56.866650 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-dcc89f3b-60cf-4889-b8b0-cae5681baf35 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:56.867614 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-dcc89f3b-60cf-4889-b8b0-cae5681baf35 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:56.870576 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:56.876143 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dcc89f3b-60cf-4889-b8b0-cae5681baf35 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:56.876601 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dcc89f3b-60cf-4889-b8b0-cae5681baf35 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:56.877023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dcc89f3b-60cf-4889-b8b0-cae5681baf35 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:56.877698 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dcc89f3b-60cf-4889-b8b0-cae5681baf35 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:56.878137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dcc89f3b-60cf-4889-b8b0-cae5681baf35 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:56.878548 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dcc89f3b-60cf-4889-b8b0-cae5681baf35 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:56.904680 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0b44d34e-b5a1-49df-915b-beb1c278cdc1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:56.905265 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0b44d34e-b5a1-49df-915b-beb1c278cdc1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:56.912355 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0b44d34e-b5a1-49df-915b-beb1c278cdc1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:56.912835 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0b44d34e-b5a1-49df-915b-beb1c278cdc1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:56.913264 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0b44d34e-b5a1-49df-915b-beb1c278cdc1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:56.913913 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0b44d34e-b5a1-49df-915b-beb1c278cdc1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:56.914389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0b44d34e-b5a1-49df-915b-beb1c278cdc1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:56.914787 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0b44d34e-b5a1-49df-915b-beb1c278cdc1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:57.056709 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-dcc89f3b-60cf-4889-b8b0-cae5681baf35 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:57.065047 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-dcc89f3b-60cf-4889-b8b0-cae5681baf35 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.205592 Oct 04 08:58:57.065676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 405/771] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:56 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:57.083033 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0b44d34e-b5a1-49df-915b-beb1c278cdc1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:57.096127 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0b44d34e-b5a1-49df-915b-beb1c278cdc1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.195085 Oct 04 08:58:57.096884 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 367/772] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:56 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:57.621567 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-470a9aee-0369-46a4-b7a2-d8c847f51f90 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:57.622155 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-470a9aee-0369-46a4-b7a2-d8c847f51f90 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:57.628751 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-470a9aee-0369-46a4-b7a2-d8c847f51f90 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:57.629262 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-470a9aee-0369-46a4-b7a2-d8c847f51f90 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:57.629699 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-470a9aee-0369-46a4-b7a2-d8c847f51f90 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:57.630398 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-470a9aee-0369-46a4-b7a2-d8c847f51f90 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:57.630847 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-470a9aee-0369-46a4-b7a2-d8c847f51f90 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:57.631268 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-470a9aee-0369-46a4-b7a2-d8c847f51f90 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:57.764413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-470a9aee-0369-46a4-b7a2-d8c847f51f90 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:57.772745 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-470a9aee-0369-46a4-b7a2-d8c847f51f90 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:57.774200 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-470a9aee-0369-46a4-b7a2-d8c847f51f90 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:57.775389 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-470a9aee-0369-46a4-b7a2-d8c847f51f90 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.159649 Oct 04 08:58:57.775971 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 406/773] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:57 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:58.088113 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c302d992-fa6f-48cf-adb5-31aa85dc965d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:58.088782 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c302d992-fa6f-48cf-adb5-31aa85dc965d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:58.095521 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c302d992-fa6f-48cf-adb5-31aa85dc965d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:58.096042 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c302d992-fa6f-48cf-adb5-31aa85dc965d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:58.096478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c302d992-fa6f-48cf-adb5-31aa85dc965d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:58.097171 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c302d992-fa6f-48cf-adb5-31aa85dc965d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:58.097623 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c302d992-fa6f-48cf-adb5-31aa85dc965d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:58.098046 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c302d992-fa6f-48cf-adb5-31aa85dc965d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:58.122656 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-734865e8-4371-4a1a-ae38-f570e9abd127 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:58.123228 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-734865e8-4371-4a1a-ae38-f570e9abd127 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:58.129928 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-734865e8-4371-4a1a-ae38-f570e9abd127 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:58.130663 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-734865e8-4371-4a1a-ae38-f570e9abd127 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:58.131283 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-734865e8-4371-4a1a-ae38-f570e9abd127 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:58.132178 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-734865e8-4371-4a1a-ae38-f570e9abd127 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:58.132777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-734865e8-4371-4a1a-ae38-f570e9abd127 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:58.133353 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-734865e8-4371-4a1a-ae38-f570e9abd127 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:58.503286 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c302d992-fa6f-48cf-adb5-31aa85dc965d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:58.511012 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c302d992-fa6f-48cf-adb5-31aa85dc965d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.426914 Oct 04 08:58:58.511591 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 368/774] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:58 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:58.531321 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-734865e8-4371-4a1a-ae38-f570e9abd127 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:58.540108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-734865e8-4371-4a1a-ae38-f570e9abd127 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1737 microversion: 2.1 time: 0.421186 Oct 04 08:58:58.540873 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 407/775] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:58 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1737 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:58.616798 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-76701337-172c-4b29-97e4-f480a036c89a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:58.617288 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-76701337-172c-4b29-97e4-f480a036c89a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:58.623358 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76701337-172c-4b29-97e4-f480a036c89a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:58.623836 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76701337-172c-4b29-97e4-f480a036c89a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:58.624296 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76701337-172c-4b29-97e4-f480a036c89a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:58.624973 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76701337-172c-4b29-97e4-f480a036c89a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:58.625421 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76701337-172c-4b29-97e4-f480a036c89a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:58.625833 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76701337-172c-4b29-97e4-f480a036c89a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:58.707159 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-76701337-172c-4b29-97e4-f480a036c89a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lazy-loading 'services' on Instance uuid 86725d76-c18e-4df2-94ff-93d73b5bc65f {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:58:58.784584 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-76701337-172c-4b29-97e4-f480a036c89a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "DELETE /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/os-volume_attachments/a65c23bf-b508-433f-b91b-b325f8e5ba52" status: 202 len: 0 microversion: 2.1 time: 0.271666 Oct 04 08:58:58.785175 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 369/776] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Oct 4 08:58:58 2022] DELETE /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/os-volume_attachments/a65c23bf-b508-433f-b91b-b325f8e5ba52 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:58:58.800439 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b9c86910-2eeb-4a93-93e9-991d2302d69d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:58.801054 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b9c86910-2eeb-4a93-93e9-991d2302d69d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:58.806980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9c86910-2eeb-4a93-93e9-991d2302d69d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:58.807462 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9c86910-2eeb-4a93-93e9-991d2302d69d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:58.807916 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9c86910-2eeb-4a93-93e9-991d2302d69d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:58.808613 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9c86910-2eeb-4a93-93e9-991d2302d69d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:58.809060 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9c86910-2eeb-4a93-93e9-991d2302d69d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:58.809447 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9c86910-2eeb-4a93-93e9-991d2302d69d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:58.938843 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b9c86910-2eeb-4a93-93e9-991d2302d69d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:58.947158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b9c86910-2eeb-4a93-93e9-991d2302d69d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:58.948683 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b9c86910-2eeb-4a93-93e9-991d2302d69d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:58.949846 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b9c86910-2eeb-4a93-93e9-991d2302d69d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.153255 Oct 04 08:58:58.950422 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 408/777] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:58 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:59.535754 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e227532b-567b-446f-970e-3aab51577cc0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:59.536609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e227532b-567b-446f-970e-3aab51577cc0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:59.543308 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e227532b-567b-446f-970e-3aab51577cc0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:59.543860 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e227532b-567b-446f-970e-3aab51577cc0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:59.544441 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e227532b-567b-446f-970e-3aab51577cc0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:59.545195 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e227532b-567b-446f-970e-3aab51577cc0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:59.545837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e227532b-567b-446f-970e-3aab51577cc0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:59.546598 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e227532b-567b-446f-970e-3aab51577cc0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:59.608046 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-8d6db912-de5c-47b4-910c-b94444cbd6e6 req-4931873c-339a-4490-88f4-7f8cd8c52cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5d6881-b38b-43b8-91c1-84e3e1338d9f", "name": "network-vif-plugged", "status": "completed", "tag": "7964acdb-66e8-472d-b77c-526ae4282bc9"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:59.623870 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-8d6db912-de5c-47b4-910c-b94444cbd6e6 req-4931873c-339a-4490-88f4-7f8cd8c52cf9 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:59.624888 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-8d6db912-de5c-47b4-910c-b94444cbd6e6 req-4931873c-339a-4490-88f4-7f8cd8c52cf9 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:59.625318 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-8d6db912-de5c-47b4-910c-b94444cbd6e6 req-4931873c-339a-4490-88f4-7f8cd8c52cf9 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:59.640104 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-8d6db912-de5c-47b4-910c-b94444cbd6e6 req-4931873c-339a-4490-88f4-7f8cd8c52cf9 service nova] Creating event network-vif-plugged:7964acdb-66e8-472d-b77c-526ae4282bc9 for instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f on hv-cinder-84456 Oct 04 08:58:59.645228 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-8d6db912-de5c-47b4-910c-b94444cbd6e6 req-4931873c-339a-4490-88f4-7f8cd8c52cf9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103043 Oct 04 08:58:59.645769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 409/778] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:58:59.656005 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-fd871978-296a-4ed2-8726-a5b766a3b573 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:59.656708 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-fd871978-296a-4ed2-8726-a5b766a3b573 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:59.663563 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fd871978-296a-4ed2-8726-a5b766a3b573 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:59.664125 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fd871978-296a-4ed2-8726-a5b766a3b573 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:59.664558 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fd871978-296a-4ed2-8726-a5b766a3b573 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:59.665275 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fd871978-296a-4ed2-8726-a5b766a3b573 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:59.665734 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fd871978-296a-4ed2-8726-a5b766a3b573 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:59.666152 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fd871978-296a-4ed2-8726-a5b766a3b573 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:59.844871 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e227532b-567b-446f-970e-3aab51577cc0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:59.858103 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e227532b-567b-446f-970e-3aab51577cc0 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.327305 Oct 04 08:58:59.874760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 370/779] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:59 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:59.925863 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-fd871978-296a-4ed2-8726-a5b766a3b573 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:59.933817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:59.940333 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-fd871978-296a-4ed2-8726-a5b766a3b573 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1717 microversion: 2.1 time: 0.290320 Oct 04 08:58:59.940922 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 410/780] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:59 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1717 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:59.977224 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-89923082-cbfe-4028-9346-0aaf20c23c20 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:59.977931 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-89923082-cbfe-4028-9346-0aaf20c23c20 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:59.984372 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-89923082-cbfe-4028-9346-0aaf20c23c20 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:59.984877 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-89923082-cbfe-4028-9346-0aaf20c23c20 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:59.985465 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-89923082-cbfe-4028-9346-0aaf20c23c20 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:59.986327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-89923082-cbfe-4028-9346-0aaf20c23c20 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:59.986778 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-89923082-cbfe-4028-9346-0aaf20c23c20 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:59.987195 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-89923082-cbfe-4028-9346-0aaf20c23c20 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:59.991955 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:00.006638 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-310dea39-b027-4690-a042-cf915f70f53e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:00.007609 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-310dea39-b027-4690-a042-cf915f70f53e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:00.014161 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-310dea39-b027-4690-a042-cf915f70f53e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:00.014733 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-310dea39-b027-4690-a042-cf915f70f53e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:00.015613 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-310dea39-b027-4690-a042-cf915f70f53e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:00.016699 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-310dea39-b027-4690-a042-cf915f70f53e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:00.017560 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-310dea39-b027-4690-a042-cf915f70f53e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:00.018204 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-310dea39-b027-4690-a042-cf915f70f53e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:00.115003 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-310dea39-b027-4690-a042-cf915f70f53e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] HTTP exception thrown: Cannot 'detach_volume' instance e8d4e170-63f9-4fa3-858f-9be84ff18613 while it is in vm_state rescued Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-310dea39-b027-4690-a042-cf915f70f53e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Request method failure captured: Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: DELETE /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/os-volume_attachments/ad04fac4-3f96-4fa6-9e49-30fdcf77be97 HTTP/1.1 Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_QgccWxYajYjnYlxW2wOpmxEq7P2SD3jaoRxscKzYQChsbHwOl030EUF30Pu5JsIqD55efxkHlt99A0cxoM9Jnpj9RKPjJ0Gow11cqdorfXuhDlAAQMZmcLNdYXLD6ljS836T8ojAOd2thWO0Qa3jMLRufhlcsdQKqvbl-NKe8LtTQ Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: ba66b134261b494b964e9f050449a0fe Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1657257525 Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 08:59:00.117030 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 08:59:00.118443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ba66b134261b494b964e9f050449a0fe", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ba66b134261b494b964e9f050449a0fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ba66b134261b494b964e9f050449a0fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ba66b134261b494b964e9f050449a0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:59:00.118443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1657257525 Oct 04 08:59:00.118443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: ba66b134261b494b964e9f050449a0fe Oct 04 08:59:00.118443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1657257525 Oct 04 08:59:00.118443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-ServerRescueNegativeTestJSON-1657257525-project Oct 04 08:59:00.118443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 08:59:00.118443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 08:59:00.118443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 1d22ff09fb6743c2880af0d7778fb984 Oct 04 08:59:00.118443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1657257525-project Oct 04 08:59:00.118443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 08:59:00.118443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Cannot 'detach_volume' instance e8d4e170-63f9-4fa3-858f-9be84ff18613 while it is in vm_state rescued Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'server_id': 'e8d4e170-63f9-4fa3-858f-9be84ff18613', 'id': 'ad04fac4-3f96-4fa6-9e49-30fdcf77be97'} Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e8d4e170-63f9-4fa3-858f-9be84ff18613 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:00.119157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e8d4e170-63f9-4fa3-858f-9be84ff18613 while it is in vm_state rescued Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e8d4e170-63f9-4fa3-858f-9be84ff18613 while it is in vm_state rescued Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:59:00.120640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-310dea39-b027-4690-a042-cf915f70f53e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Returning 409 to user: Cannot 'detach_volume' instance e8d4e170-63f9-4fa3-858f-9be84ff18613 while it is in vm_state rescued {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:00.121642 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-310dea39-b027-4690-a042-cf915f70f53e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/os-volume_attachments/ad04fac4-3f96-4fa6-9e49-30fdcf77be97" status: 409 len: 152 microversion: 2.1 time: 0.116324 Oct 04 08:59:00.122812 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 411/781] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Oct 4 08:59:00 2022] DELETE /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/os-volume_attachments/ad04fac4-3f96-4fa6-9e49-30fdcf77be97 => generated 152 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 08:59:00.127848 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ff91cd1b-07c6-40ea-a8ce-11b209dbd4f5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:00.128628 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ff91cd1b-07c6-40ea-a8ce-11b209dbd4f5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:00.136393 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ff91cd1b-07c6-40ea-a8ce-11b209dbd4f5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:00.136930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ff91cd1b-07c6-40ea-a8ce-11b209dbd4f5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:00.137580 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ff91cd1b-07c6-40ea-a8ce-11b209dbd4f5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:00.138467 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ff91cd1b-07c6-40ea-a8ce-11b209dbd4f5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:00.139084 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ff91cd1b-07c6-40ea-a8ce-11b209dbd4f5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:00.139501 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ff91cd1b-07c6-40ea-a8ce-11b209dbd4f5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:00.209791 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ff91cd1b-07c6-40ea-a8ce-11b209dbd4f5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "POST /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/action" status: 202 len: 0 microversion: 2.1 time: 0.085714 Oct 04 08:59:00.210776 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 412/782] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Oct 4 08:59:00 2022] POST /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:59:00.220080 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e3089a89-9a8e-447d-b9a9-c5a3030e02db tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:00.220771 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e3089a89-9a8e-447d-b9a9-c5a3030e02db tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:00.227040 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3089a89-9a8e-447d-b9a9-c5a3030e02db tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:00.227529 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3089a89-9a8e-447d-b9a9-c5a3030e02db tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:00.228069 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3089a89-9a8e-447d-b9a9-c5a3030e02db tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:00.228766 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3089a89-9a8e-447d-b9a9-c5a3030e02db tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:00.229267 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3089a89-9a8e-447d-b9a9-c5a3030e02db tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:00.229692 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e3089a89-9a8e-447d-b9a9-c5a3030e02db tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:00.236747 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-89923082-cbfe-4028-9346-0aaf20c23c20 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:00.245158 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-89923082-cbfe-4028-9346-0aaf20c23c20 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:00.246635 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-89923082-cbfe-4028-9346-0aaf20c23c20 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:00.248033 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-89923082-cbfe-4028-9346-0aaf20c23c20 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1723 microversion: 2.20 time: 0.276028 Oct 04 08:59:00.248747 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 371/783] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:59 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:00.416541 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e3089a89-9a8e-447d-b9a9-c5a3030e02db tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:00.425604 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e3089a89-9a8e-447d-b9a9-c5a3030e02db tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1725 microversion: 2.1 time: 0.209490 Oct 04 08:59:00.426254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 413/784] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:00 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:00.796396 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-8995d397-3256-4138-bdcf-a15e99f3edfd req-a1d60392-3eb5-4fa7-82e1-6380bb52b5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4454abc-67a9-470b-bdce-5a69bc51bbed", "name": "network-vif-deleted", "tag": "a52bd48f-906c-4b87-b387-01e1bfaa69c2"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:00.811941 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-8995d397-3256-4138-bdcf-a15e99f3edfd req-a1d60392-3eb5-4fa7-82e1-6380bb52b5b2 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:00.812697 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-8995d397-3256-4138-bdcf-a15e99f3edfd req-a1d60392-3eb5-4fa7-82e1-6380bb52b5b2 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:00.813291 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-8995d397-3256-4138-bdcf-a15e99f3edfd req-a1d60392-3eb5-4fa7-82e1-6380bb52b5b2 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:00.860304 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-8995d397-3256-4138-bdcf-a15e99f3edfd req-a1d60392-3eb5-4fa7-82e1-6380bb52b5b2 service nova] Creating event network-vif-deleted:a52bd48f-906c-4b87-b387-01e1bfaa69c2 for instance f4454abc-67a9-470b-bdce-5a69bc51bbed on hv-cinder-84456 Oct 04 08:59:00.866907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-8995d397-3256-4138-bdcf-a15e99f3edfd req-a1d60392-3eb5-4fa7-82e1-6380bb52b5b2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076695 Oct 04 08:59:00.867987 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 372/785] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:00.881092 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-cbbb5e57-55ee-4851-b3b7-9d562bfff2b7 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:00.881716 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cbbb5e57-55ee-4851-b3b7-9d562bfff2b7 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:00.894501 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cbbb5e57-55ee-4851-b3b7-9d562bfff2b7 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:00.895002 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cbbb5e57-55ee-4851-b3b7-9d562bfff2b7 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:00.900635 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cbbb5e57-55ee-4851-b3b7-9d562bfff2b7 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:00.901673 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cbbb5e57-55ee-4851-b3b7-9d562bfff2b7 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:00.902342 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cbbb5e57-55ee-4851-b3b7-9d562bfff2b7 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:00.902777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cbbb5e57-55ee-4851-b3b7-9d562bfff2b7 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:01.116563 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cbbb5e57-55ee-4851-b3b7-9d562bfff2b7 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:01.126155 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-cbbb5e57-55ee-4851-b3b7-9d562bfff2b7 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.248810 Oct 04 08:59:01.128506 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 414/786] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:00 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:59:01.274952 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:01.276446 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:01.294037 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:01.294656 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:01.295070 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:01.295792 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:01.296273 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:01.296691 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:01.330599 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:01.331078 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:01.331495 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:01.331973 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lazy-loading 'fault' on Instance uuid f4454abc-67a9-470b-bdce-5a69bc51bbed {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:59:01.374722 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:01.383036 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:01.384481 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:01.385693 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d5d1a673-cb28-4697-a4c5-78e98cf339a3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1372 microversion: 2.20 time: 0.115042 Oct 04 08:59:01.386252 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 373/787] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:01 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1372 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:01.449750 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2d87b9a0-ec6b-4e2f-8f47-4e719e5d5905 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:01.450297 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2d87b9a0-ec6b-4e2f-8f47-4e719e5d5905 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:01.457364 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2d87b9a0-ec6b-4e2f-8f47-4e719e5d5905 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:01.457919 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2d87b9a0-ec6b-4e2f-8f47-4e719e5d5905 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:01.458254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2d87b9a0-ec6b-4e2f-8f47-4e719e5d5905 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:01.458969 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2d87b9a0-ec6b-4e2f-8f47-4e719e5d5905 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:01.459417 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2d87b9a0-ec6b-4e2f-8f47-4e719e5d5905 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:01.459832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2d87b9a0-ec6b-4e2f-8f47-4e719e5d5905 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:01.597044 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2d87b9a0-ec6b-4e2f-8f47-4e719e5d5905 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:01.606918 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2d87b9a0-ec6b-4e2f-8f47-4e719e5d5905 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1725 microversion: 2.1 time: 0.161146 Oct 04 08:59:01.611952 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 415/788] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:01 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:02.116856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-cf2c3813-5e2b-4566-944a-25e253b7b618 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:02.123804 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cf2c3813-5e2b-4566-944a-25e253b7b618 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:02.124408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cf2c3813-5e2b-4566-944a-25e253b7b618 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:02.124904 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cf2c3813-5e2b-4566-944a-25e253b7b618 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:02.147458 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-cf2c3813-5e2b-4566-944a-25e253b7b618 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Going to try to stop instance {{(pid=142439) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 08:59:02.151673 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-78a32bf3-7733-431e-a7fa-67645d830dde tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:02.152985 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-78a32bf3-7733-431e-a7fa-67645d830dde tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:02.159323 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-78a32bf3-7733-431e-a7fa-67645d830dde tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:02.159817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-78a32bf3-7733-431e-a7fa-67645d830dde tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:02.160516 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-78a32bf3-7733-431e-a7fa-67645d830dde tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:02.161206 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-78a32bf3-7733-431e-a7fa-67645d830dde tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:02.161630 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-78a32bf3-7733-431e-a7fa-67645d830dde tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:02.162274 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-78a32bf3-7733-431e-a7fa-67645d830dde tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:02.193242 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-cf2c3813-5e2b-4566-944a-25e253b7b618 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "POST /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/action" status: 202 len: 0 microversion: 2.1 time: 0.080414 Oct 04 08:59:02.194098 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 374/789] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Oct 4 08:59:02 2022] POST /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:59:02.202576 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f9aa5172-1788-4527-8c90-15ac49321512 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:02.203481 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f9aa5172-1788-4527-8c90-15ac49321512 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:02.209887 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9aa5172-1788-4527-8c90-15ac49321512 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:02.210455 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9aa5172-1788-4527-8c90-15ac49321512 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:02.210884 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9aa5172-1788-4527-8c90-15ac49321512 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:02.211568 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9aa5172-1788-4527-8c90-15ac49321512 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:02.212125 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9aa5172-1788-4527-8c90-15ac49321512 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:02.212544 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9aa5172-1788-4527-8c90-15ac49321512 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:02.343404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-78a32bf3-7733-431e-a7fa-67645d830dde tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:02.351856 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-78a32bf3-7733-431e-a7fa-67645d830dde tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1358 microversion: 2.1 time: 0.204993 Oct 04 08:59:02.352831 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 416/790] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:02 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:02.374074 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f9aa5172-1788-4527-8c90-15ac49321512 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:02.383083 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f9aa5172-1788-4527-8c90-15ac49321512 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.184557 Oct 04 08:59:02.383689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 375/791] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:02 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:59:02.410752 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:02.411356 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:02.417563 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:02.418040 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:02.418468 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:02.419156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:02.419603 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:02.420125 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:02.453731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:02.454500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:02.455247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:02.456075 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lazy-loading 'fault' on Instance uuid f4454abc-67a9-470b-bdce-5a69bc51bbed {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:59:02.503645 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:02.512344 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:02.513778 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:02.514927 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2a9e7b64-0462-436b-b5d8-854c76264556 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1372 microversion: 2.20 time: 0.108217 Oct 04 08:59:02.515489 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 417/792] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:02 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:02.630784 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b9954c01-7140-4a79-bc1b-7b4fe3902d31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:02.631403 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b9954c01-7140-4a79-bc1b-7b4fe3902d31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:02.638165 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9954c01-7140-4a79-bc1b-7b4fe3902d31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:02.638651 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9954c01-7140-4a79-bc1b-7b4fe3902d31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:02.639087 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9954c01-7140-4a79-bc1b-7b4fe3902d31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:02.639801 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9954c01-7140-4a79-bc1b-7b4fe3902d31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:02.640293 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9954c01-7140-4a79-bc1b-7b4fe3902d31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:02.640716 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9954c01-7140-4a79-bc1b-7b4fe3902d31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:02.803240 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b9954c01-7140-4a79-bc1b-7b4fe3902d31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:02.811844 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b9954c01-7140-4a79-bc1b-7b4fe3902d31 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1725 microversion: 2.1 time: 0.184999 Oct 04 08:59:02.812799 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 376/793] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:02 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:03.375813 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-dc8358ff-868f-499a-aa20-edb89dc8db11 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:03.376798 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-dc8358ff-868f-499a-aa20-edb89dc8db11 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:03.384805 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc8358ff-868f-499a-aa20-edb89dc8db11 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:03.385303 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc8358ff-868f-499a-aa20-edb89dc8db11 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:03.385782 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc8358ff-868f-499a-aa20-edb89dc8db11 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:03.386583 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc8358ff-868f-499a-aa20-edb89dc8db11 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:03.387191 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc8358ff-868f-499a-aa20-edb89dc8db11 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:03.387621 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc8358ff-868f-499a-aa20-edb89dc8db11 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:03.406643 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c47003b9-40e3-4a7e-a711-3706a01e33b3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:03.407414 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c47003b9-40e3-4a7e-a711-3706a01e33b3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:03.419440 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c47003b9-40e3-4a7e-a711-3706a01e33b3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:03.421283 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c47003b9-40e3-4a7e-a711-3706a01e33b3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:03.421762 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c47003b9-40e3-4a7e-a711-3706a01e33b3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:03.422517 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c47003b9-40e3-4a7e-a711-3706a01e33b3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:03.422985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c47003b9-40e3-4a7e-a711-3706a01e33b3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:03.423415 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c47003b9-40e3-4a7e-a711-3706a01e33b3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:03.598855 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-dc8358ff-868f-499a-aa20-edb89dc8db11 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:03.602207 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c47003b9-40e3-4a7e-a711-3706a01e33b3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:03.606640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-dc8358ff-868f-499a-aa20-edb89dc8db11 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1549 microversion: 2.1 time: 0.235733 Oct 04 08:59:03.607176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 418/794] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:03 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1549 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:03.610401 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c47003b9-40e3-4a7e-a711-3706a01e33b3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.207654 Oct 04 08:59:03.611051 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 377/795] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:03 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:03.611523 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:03.612342 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:03.618504 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:03.618976 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:03.619399 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:03.620292 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:03.620795 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:03.621209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:03.630146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-93647e20-baaa-4fba-ab50-210e1e51abae tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:03.630855 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-93647e20-baaa-4fba-ab50-210e1e51abae tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:03.644003 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93647e20-baaa-4fba-ab50-210e1e51abae tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:03.644524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93647e20-baaa-4fba-ab50-210e1e51abae tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:03.644970 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93647e20-baaa-4fba-ab50-210e1e51abae tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:03.645942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93647e20-baaa-4fba-ab50-210e1e51abae tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:03.646410 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93647e20-baaa-4fba-ab50-210e1e51abae tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:03.646842 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93647e20-baaa-4fba-ab50-210e1e51abae tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:03.654641 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:03.655149 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:03.655613 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:03.656098 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lazy-loading 'fault' on Instance uuid f4454abc-67a9-470b-bdce-5a69bc51bbed {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:59:03.704294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:03.712810 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:03.714337 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:03.715494 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-719b8594-1847-48c0-a9fd-81304d0785c1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1372 microversion: 2.20 time: 0.107385 Oct 04 08:59:03.716075 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 419/796] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:03 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:03.791789 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-93647e20-baaa-4fba-ab50-210e1e51abae tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:03.801283 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-93647e20-baaa-4fba-ab50-210e1e51abae tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1549 microversion: 2.1 time: 0.175353 Oct 04 08:59:03.801861 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 378/797] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:03 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:03.823235 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-87567a7f-0b96-42b0-bdf8-f472278b6a03 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:03.828107 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-87567a7f-0b96-42b0-bdf8-f472278b6a03 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:03.828854 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-87567a7f-0b96-42b0-bdf8-f472278b6a03 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Searching by: {'deleted': False, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637'} {{(pid=142438) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 08:59:03.834337 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4b443b6c-d64e-46c1-8123-14da105b8300 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:03.834969 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4b443b6c-d64e-46c1-8123-14da105b8300 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:03.836066 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-87567a7f-0b96-42b0-bdf8-f472278b6a03 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:03.836532 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-87567a7f-0b96-42b0-bdf8-f472278b6a03 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:03.836936 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-87567a7f-0b96-42b0-bdf8-f472278b6a03 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:03.837640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-87567a7f-0b96-42b0-bdf8-f472278b6a03 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:03.838075 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-87567a7f-0b96-42b0-bdf8-f472278b6a03 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:03.838516 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-87567a7f-0b96-42b0-bdf8-f472278b6a03 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:03.840924 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b443b6c-d64e-46c1-8123-14da105b8300 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:03.841402 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b443b6c-d64e-46c1-8123-14da105b8300 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:03.841831 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b443b6c-d64e-46c1-8123-14da105b8300 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:03.842504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b443b6c-d64e-46c1-8123-14da105b8300 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:03.842950 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b443b6c-d64e-46c1-8123-14da105b8300 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:03.843360 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4b443b6c-d64e-46c1-8123-14da105b8300 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:03.925726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.multi_cell_list [None req-87567a7f-0b96-42b0-bdf8-f472278b6a03 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142438) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 08:59:03.978576 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4b443b6c-d64e-46c1-8123-14da105b8300 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:03.987174 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4b443b6c-d64e-46c1-8123-14da105b8300 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1725 microversion: 2.1 time: 0.156569 Oct 04 08:59:03.987742 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 379/798] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:03 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:04.021275 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-87567a7f-0b96-42b0-bdf8-f472278b6a03 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201785 Oct 04 08:59:04.021764 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 420/799] 10.222.0.44 () {58 vars in 1125 bytes} [Tue Oct 4 08:59:03 2022] GET /compute/v2.1/servers => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:59:04.033356 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-28ddba5d-a50b-4546-b6e1-e4b425e43362 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:04.033963 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-28ddba5d-a50b-4546-b6e1-e4b425e43362 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:04.039960 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-28ddba5d-a50b-4546-b6e1-e4b425e43362 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:04.040437 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-28ddba5d-a50b-4546-b6e1-e4b425e43362 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:04.040861 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-28ddba5d-a50b-4546-b6e1-e4b425e43362 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:04.041612 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-28ddba5d-a50b-4546-b6e1-e4b425e43362 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:04.042095 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-28ddba5d-a50b-4546-b6e1-e4b425e43362 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:04.042509 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-28ddba5d-a50b-4546-b6e1-e4b425e43362 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:04.195179 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-28ddba5d-a50b-4546-b6e1-e4b425e43362 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:04.203693 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-28ddba5d-a50b-4546-b6e1-e4b425e43362 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1549 microversion: 2.1 time: 0.174120 Oct 04 08:59:04.204300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 380/800] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:04 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:04.635190 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0ded9443-2af3-4191-8ea1-5100e4bbab98 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:04.635794 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0ded9443-2af3-4191-8ea1-5100e4bbab98 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:04.642742 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0ded9443-2af3-4191-8ea1-5100e4bbab98 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:04.643218 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0ded9443-2af3-4191-8ea1-5100e4bbab98 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:04.643647 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0ded9443-2af3-4191-8ea1-5100e4bbab98 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:04.644355 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0ded9443-2af3-4191-8ea1-5100e4bbab98 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:04.644814 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0ded9443-2af3-4191-8ea1-5100e4bbab98 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:04.645230 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0ded9443-2af3-4191-8ea1-5100e4bbab98 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:04.746693 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:04.747349 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:04.750104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:04.756327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:04.756946 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:04.757398 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:04.758118 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:04.758615 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:04.759103 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:04.779356 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0ded9443-2af3-4191-8ea1-5100e4bbab98 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:04.787494 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0ded9443-2af3-4191-8ea1-5100e4bbab98 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.156378 Oct 04 08:59:04.788115 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 421/801] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:04 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:04.793326 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:04.793959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:04.794391 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:04.794962 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lazy-loading 'fault' on Instance uuid f4454abc-67a9-470b-bdce-5a69bc51bbed {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:59:04.834306 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:04.842948 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:04.844508 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:04.845701 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-3fa7232d-0ef4-4389-bcc0-2b15031966ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 200 len: 1372 microversion: 2.20 time: 0.103419 Oct 04 08:59:04.846263 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 381/802] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:04 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:05.012300 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e132f011-4d4a-46cd-a19a-ec13ff9724ad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:05.013029 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e132f011-4d4a-46cd-a19a-ec13ff9724ad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:05.020435 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e132f011-4d4a-46cd-a19a-ec13ff9724ad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:05.021109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e132f011-4d4a-46cd-a19a-ec13ff9724ad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:05.021627 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e132f011-4d4a-46cd-a19a-ec13ff9724ad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:05.022432 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e132f011-4d4a-46cd-a19a-ec13ff9724ad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:05.022967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e132f011-4d4a-46cd-a19a-ec13ff9724ad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:05.023461 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e132f011-4d4a-46cd-a19a-ec13ff9724ad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:05.155163 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e132f011-4d4a-46cd-a19a-ec13ff9724ad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:05.163726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e132f011-4d4a-46cd-a19a-ec13ff9724ad tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1725 microversion: 2.1 time: 0.156217 Oct 04 08:59:05.164338 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 422/803] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:05 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:05.801176 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-88f827e4-1762-4e15-8cff-da44ab681902 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79a42d2a-64bd-408e-90cd-82e58d9cc980"}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:05.803836 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-88f827e4-1762-4e15-8cff-da44ab681902 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:05.810239 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-88f827e4-1762-4e15-8cff-da44ab681902 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:05.810497 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f58200f7-a765-4810-b6a3-bbe63ca69f8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:05.810985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-88f827e4-1762-4e15-8cff-da44ab681902 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:05.811112 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f58200f7-a765-4810-b6a3-bbe63ca69f8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:05.811210 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-88f827e4-1762-4e15-8cff-da44ab681902 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:05.811831 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-88f827e4-1762-4e15-8cff-da44ab681902 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:05.812306 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-88f827e4-1762-4e15-8cff-da44ab681902 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:05.812728 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-88f827e4-1762-4e15-8cff-da44ab681902 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:05.818386 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f58200f7-a765-4810-b6a3-bbe63ca69f8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:05.819109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f58200f7-a765-4810-b6a3-bbe63ca69f8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:05.819540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f58200f7-a765-4810-b6a3-bbe63ca69f8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:05.820363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f58200f7-a765-4810-b6a3-bbe63ca69f8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:05.821000 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f58200f7-a765-4810-b6a3-bbe63ca69f8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:05.821418 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f58200f7-a765-4810-b6a3-bbe63ca69f8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:05.953782 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f58200f7-a765-4810-b6a3-bbe63ca69f8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:05.961884 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f58200f7-a765-4810-b6a3-bbe63ca69f8b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.155259 Oct 04 08:59:05.962423 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 423/804] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:05 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:59:05.967023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c97188b3-e70d-4c6b-a95f-0f651693d4b3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:05.967618 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c97188b3-e70d-4c6b-a95f-0f651693d4b3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:05.973672 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c97188b3-e70d-4c6b-a95f-0f651693d4b3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:05.974252 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c97188b3-e70d-4c6b-a95f-0f651693d4b3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:05.974687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c97188b3-e70d-4c6b-a95f-0f651693d4b3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:05.975382 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c97188b3-e70d-4c6b-a95f-0f651693d4b3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:05.975833 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c97188b3-e70d-4c6b-a95f-0f651693d4b3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:05.976284 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c97188b3-e70d-4c6b-a95f-0f651693d4b3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:05.989724 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-c97188b3-e70d-4c6b-a95f-0f651693d4b3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] HTTP exception thrown: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c97188b3-e70d-4c6b-a95f-0f651693d4b3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Request method failure captured: Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed HTTP/1.1 Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_QicjPpnyO013RuvkG92z1S22OX7H2md5ngYNnXz3ZPNd5NdIokT1HjZPVfLGEqDdJv6yEKaccbr7o56oa_UUEoFW5frrn-m21DZpmA2K1poYeLETAHGlJFoGhJhe-w6DW2EY21A8faNXuseAT8P7uYYKfFNUfe2IzlIT8KKs2LGxU Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: d255b03b31004c3b8e446f318cd72265 Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 08:59:05.991726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 08:59:05.993246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d255b03b31004c3b8e446f318cd72265", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 08:59:05.993246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 08:59:05.993246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: d255b03b31004c3b8e446f318cd72265 Oct 04 08:59:05.993246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 08:59:05.993246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-AttachVolumeShelveTestJSON-567630336-project Oct 04 08:59:05.993246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 08:59:05.993246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 08:59:05.993246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 68288f4e2f57454fbb06eff0dd72cca3 Oct 04 08:59:05.993246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-AttachVolumeShelveTestJSON-567630336-project Oct 04 08:59:05.993246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 08:59:05.993246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. Oct 04 08:59:05.993246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': 'f4454abc-67a9-470b-bdce-5a69bc51bbed'} Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:05.994254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. Oct 04 08:59:05.995761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 08:59:05.997477 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c97188b3-e70d-4c6b-a95f-0f651693d4b3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Returning 404 to user: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:05.997477 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c97188b3-e70d-4c6b-a95f-0f651693d4b3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 404 len: 111 microversion: 2.20 time: 0.029615 Oct 04 08:59:05.997477 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 424/805] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:05 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:59:06.001802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4ccf8e1c-595d-42d4-976a-ac4be97c0350 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '.version_select at 0x7ff92e29b820>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:06.027853 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4ccf8e1c-595d-42d4-976a-ac4be97c0350 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152232857" status: 204 len: 0 microversion: 2.20 time: 0.029454 Oct 04 08:59:06.028455 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 425/806] 10.222.0.44 () {60 vars in 1262 bytes} [Tue Oct 4 08:59:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152232857 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 08:59:06.188935 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-19a4fa4d-c6b0-4d0b-bd30-4c174afad1c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:06.189643 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-19a4fa4d-c6b0-4d0b-bd30-4c174afad1c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:06.198208 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-19a4fa4d-c6b0-4d0b-bd30-4c174afad1c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:06.198733 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-19a4fa4d-c6b0-4d0b-bd30-4c174afad1c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:06.199245 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-19a4fa4d-c6b0-4d0b-bd30-4c174afad1c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:06.200103 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-19a4fa4d-c6b0-4d0b-bd30-4c174afad1c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:06.200755 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-19a4fa4d-c6b0-4d0b-bd30-4c174afad1c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:06.201265 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-19a4fa4d-c6b0-4d0b-bd30-4c174afad1c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:06.429464 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-19a4fa4d-c6b0-4d0b-bd30-4c174afad1c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:06.438727 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-19a4fa4d-c6b0-4d0b-bd30-4c174afad1c7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1725 microversion: 2.1 time: 0.254884 Oct 04 08:59:06.439500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 426/807] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:06 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:06.642411 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-88f827e4-1762-4e15-8cff-da44ab681902 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "POST /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.845089 Oct 04 08:59:06.643124 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 382/808] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Oct 4 08:59:05 2022] POST /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/os-volume_attachments => generated 194 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:06.742588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-be75c7df-210e-464c-b065-490724ba7b49 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Action: 'create', calling method: .version_select at 0x7ff92e2ae280>, body: {"keypair": {"name": "tempest-keypair-654476180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIT9b4AfJaVjBsrlZz6hCjc2pPlbHKTyNYy0Upv1mSsaxD49xNJlLKt7KE/eXutRkwxRuRBT6HImvXMDN1g35ArF4jrVUK22EuvHbqffw8egP8C7kC375psX7OSq7VqPXQ=="}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:06.757690 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-be75c7df-210e-464c-b065-490724ba7b49 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Getting quotas for project d255b03b31004c3b8e446f318cd72265. Resources: {'key_pairs'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:59:06.761640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-be75c7df-210e-464c-b065-490724ba7b49 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Getting quotas for user 68288f4e2f57454fbb06eff0dd72cca3 and project d255b03b31004c3b8e446f318cd72265. Resources: {'key_pairs'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:59:06.785562 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-be75c7df-210e-464c-b065-490724ba7b49 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047175 Oct 04 08:59:06.786158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 427/809] 10.222.0.44 () {62 vars in 1200 bytes} [Tue Oct 4 08:59:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 08:59:06.986428 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d0c7807f-c70a-4c20-bcdb-0c866e6e5c5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:06.987111 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d0c7807f-c70a-4c20-bcdb-0c866e6e5c5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:06.993667 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0c7807f-c70a-4c20-bcdb-0c866e6e5c5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:06.994149 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0c7807f-c70a-4c20-bcdb-0c866e6e5c5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:06.994578 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0c7807f-c70a-4c20-bcdb-0c866e6e5c5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:06.995257 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0c7807f-c70a-4c20-bcdb-0c866e6e5c5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:06.995700 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0c7807f-c70a-4c20-bcdb-0c866e6e5c5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:06.996167 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0c7807f-c70a-4c20-bcdb-0c866e6e5c5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:07.136449 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d0c7807f-c70a-4c20-bcdb-0c866e6e5c5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:07.145082 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d0c7807f-c70a-4c20-bcdb-0c866e6e5c5c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.163379 Oct 04 08:59:07.145714 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 383/810] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:06 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:07.463325 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-83fc6a3c-ece1-4df9-aab7-80485b629e2e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:07.464569 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-83fc6a3c-ece1-4df9-aab7-80485b629e2e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:07.471331 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-83fc6a3c-ece1-4df9-aab7-80485b629e2e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:07.471815 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-83fc6a3c-ece1-4df9-aab7-80485b629e2e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:07.472301 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-83fc6a3c-ece1-4df9-aab7-80485b629e2e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:07.473065 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-83fc6a3c-ece1-4df9-aab7-80485b629e2e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:07.473544 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-83fc6a3c-ece1-4df9-aab7-80485b629e2e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:07.473973 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-83fc6a3c-ece1-4df9-aab7-80485b629e2e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:07.479122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:07.606089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-83fc6a3c-ece1-4df9-aab7-80485b629e2e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:07.615344 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-83fc6a3c-ece1-4df9-aab7-80485b629e2e tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1731 microversion: 2.1 time: 0.155938 Oct 04 08:59:07.615452 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 428/811] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:07 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:07.638365 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d32541a6-e0bb-44ee-9306-6b6d7c0d7501 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:07.638859 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d32541a6-e0bb-44ee-9306-6b6d7c0d7501 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:07.645310 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d32541a6-e0bb-44ee-9306-6b6d7c0d7501 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:07.645793 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d32541a6-e0bb-44ee-9306-6b6d7c0d7501 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:07.646429 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d32541a6-e0bb-44ee-9306-6b6d7c0d7501 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:07.647637 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d32541a6-e0bb-44ee-9306-6b6d7c0d7501 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:07.648277 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d32541a6-e0bb-44ee-9306-6b6d7c0d7501 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:07.648853 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d32541a6-e0bb-44ee-9306-6b6d7c0d7501 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:07.729138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d32541a6-e0bb-44ee-9306-6b6d7c0d7501 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094719 Oct 04 08:59:07.731956 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 384/812] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Oct 4 08:59:07 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:59:08.168443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-dc4d4383-70da-4b65-8d61-4913c8fb9199 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:08.169278 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-dc4d4383-70da-4b65-8d61-4913c8fb9199 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:08.176196 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc4d4383-70da-4b65-8d61-4913c8fb9199 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:08.176865 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc4d4383-70da-4b65-8d61-4913c8fb9199 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:08.177396 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc4d4383-70da-4b65-8d61-4913c8fb9199 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:08.178205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc4d4383-70da-4b65-8d61-4913c8fb9199 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:08.178755 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc4d4383-70da-4b65-8d61-4913c8fb9199 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:08.179279 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc4d4383-70da-4b65-8d61-4913c8fb9199 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:08.361042 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1757012121", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b6df89b-d877-47b3-92a7-e51799baa62f"}], "security_groups": [{"name": "tempest-securitygroup--967484194"}], "key_name": "tempest-keypair-654476180", "user_data": "}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:08.553939 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.network.neutron [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] validate_networks() for [('4b6df89b-d877-47b3-92a7-e51799baa62f', None, None, None, None, None)] {{(pid=142439) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:59:08.662236 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-dc4d4383-70da-4b65-8d61-4913c8fb9199 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:08.673444 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-dc4d4383-70da-4b65-8d61-4913c8fb9199 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.509166 Oct 04 08:59:08.674312 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 429/813] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:08 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:09.226433 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-9ef51482-5f54-4442-8a48-c6b412a87b28 req-8d4040fc-ce14-4f4a-9b69-3cf007463abd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d4e170-63f9-4fa3-858f-9be84ff18613", "tag": "f3fc8c79-adbb-46ec-b7f3-b0d7539f5735"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:09.236677 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-9ef51482-5f54-4442-8a48-c6b412a87b28 req-8d4040fc-ce14-4f4a-9b69-3cf007463abd service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:09.237133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-9ef51482-5f54-4442-8a48-c6b412a87b28 req-8d4040fc-ce14-4f4a-9b69-3cf007463abd service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:09.237925 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-9ef51482-5f54-4442-8a48-c6b412a87b28 req-8d4040fc-ce14-4f4a-9b69-3cf007463abd service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:09.250213 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-9ef51482-5f54-4442-8a48-c6b412a87b28 req-8d4040fc-ce14-4f4a-9b69-3cf007463abd service nova] Creating event network-changed:f3fc8c79-adbb-46ec-b7f3-b0d7539f5735 for instance e8d4e170-63f9-4fa3-858f-9be84ff18613 on hv-cinder-84456 Oct 04 08:59:09.256934 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-9ef51482-5f54-4442-8a48-c6b412a87b28 req-8d4040fc-ce14-4f4a-9b69-3cf007463abd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033818 Oct 04 08:59:09.258027 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 430/814] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:09.287903 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Flavor limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:59:09.288333 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Image limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:59:09.288804 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Flavor pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:59:09.289210 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Image pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:59:09.289671 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:59:09.299207 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:09.299828 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:09.300311 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:09.301854 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:09.302326 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:09.302935 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:09.322371 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Getting quotas for project d255b03b31004c3b8e446f318cd72265. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:59:09.327162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Getting quotas for user 68288f4e2f57454fbb06eff0dd72cca3 and project d255b03b31004c3b8e446f318cd72265. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:59:09.342801 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Going to run 1 instances... {{(pid=142439) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:59:09.345191 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:59:09.398234 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2846f61c-46f0-49ec-8b9b-0eda0ac3cfca tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.042125 Oct 04 08:59:09.399233 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 385/815] 10.222.0.44 () {62 vars in 1188 bytes} [Tue Oct 4 08:59:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 08:59:09.411080 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5e529b14-b3af-44de-937d-7dc0768dc49a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:09.412164 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5e529b14-b3af-44de-937d-7dc0768dc49a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:09.481357 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5e529b14-b3af-44de-937d-7dc0768dc49a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:09.490919 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5e529b14-b3af-44de-937d-7dc0768dc49a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:09.494475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5e529b14-b3af-44de-937d-7dc0768dc49a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:09.495606 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5e529b14-b3af-44de-937d-7dc0768dc49a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1281 microversion: 2.20 time: 0.089070 Oct 04 08:59:09.496199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 431/816] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:09 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1281 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:09.697607 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f4eb95e0-a122-431f-be34-ac695f394789 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:09.698900 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f4eb95e0-a122-431f-be34-ac695f394789 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:09.709304 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f4eb95e0-a122-431f-be34-ac695f394789 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:09.709962 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f4eb95e0-a122-431f-be34-ac695f394789 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:09.710639 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f4eb95e0-a122-431f-be34-ac695f394789 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:09.711576 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f4eb95e0-a122-431f-be34-ac695f394789 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:09.712083 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f4eb95e0-a122-431f-be34-ac695f394789 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:09.712760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f4eb95e0-a122-431f-be34-ac695f394789 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:09.733185 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:09.860923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f4eb95e0-a122-431f-be34-ac695f394789 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:09.873450 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f4eb95e0-a122-431f-be34-ac695f394789 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.180121 Oct 04 08:59:09.874053 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 386/817] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:09 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:10.525248 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-06b6bdb6-6db4-4a34-8ce7-38b7258b7b9e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:10.526037 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-06b6bdb6-6db4-4a34-8ce7-38b7258b7b9e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:10.534687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-06b6bdb6-6db4-4a34-8ce7-38b7258b7b9e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:10.535160 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-06b6bdb6-6db4-4a34-8ce7-38b7258b7b9e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:10.535585 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-06b6bdb6-6db4-4a34-8ce7-38b7258b7b9e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:10.536311 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-06b6bdb6-6db4-4a34-8ce7-38b7258b7b9e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:10.536746 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-06b6bdb6-6db4-4a34-8ce7-38b7258b7b9e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:10.537158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-06b6bdb6-6db4-4a34-8ce7-38b7258b7b9e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:10.599367 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-06b6bdb6-6db4-4a34-8ce7-38b7258b7b9e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:10.608349 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-06b6bdb6-6db4-4a34-8ce7-38b7258b7b9e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:10.609772 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-06b6bdb6-6db4-4a34-8ce7-38b7258b7b9e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:10.610856 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-06b6bdb6-6db4-4a34-8ce7-38b7258b7b9e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1333 microversion: 2.20 time: 0.092169 Oct 04 08:59:10.611405 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 432/818] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:10 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:10.897338 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a9839840-9f44-4ecd-843a-0f0a443ff17a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:10.897865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a9839840-9f44-4ecd-843a-0f0a443ff17a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:10.905069 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a9839840-9f44-4ecd-843a-0f0a443ff17a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:10.905792 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a9839840-9f44-4ecd-843a-0f0a443ff17a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:10.906217 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a9839840-9f44-4ecd-843a-0f0a443ff17a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:10.906916 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a9839840-9f44-4ecd-843a-0f0a443ff17a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:10.907390 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a9839840-9f44-4ecd-843a-0f0a443ff17a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:10.907816 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a9839840-9f44-4ecd-843a-0f0a443ff17a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:11.063738 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a9839840-9f44-4ecd-843a-0f0a443ff17a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:11.074559 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a9839840-9f44-4ecd-843a-0f0a443ff17a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.181163 Oct 04 08:59:11.075524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 387/819] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:10 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:11.277596 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-ed3eaff9-7477-4a0c-974a-1e0ae81e53f1 req-8d4033a8-55c6-4405-a701-d1190c956efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d4e170-63f9-4fa3-858f-9be84ff18613", "tag": "f3fc8c79-adbb-46ec-b7f3-b0d7539f5735"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:11.287365 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-ed3eaff9-7477-4a0c-974a-1e0ae81e53f1 req-8d4033a8-55c6-4405-a701-d1190c956efa service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:11.287842 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-ed3eaff9-7477-4a0c-974a-1e0ae81e53f1 req-8d4033a8-55c6-4405-a701-d1190c956efa service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:11.288338 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-ed3eaff9-7477-4a0c-974a-1e0ae81e53f1 req-8d4033a8-55c6-4405-a701-d1190c956efa service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:11.299503 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-ed3eaff9-7477-4a0c-974a-1e0ae81e53f1 req-8d4033a8-55c6-4405-a701-d1190c956efa service nova] Creating event network-changed:f3fc8c79-adbb-46ec-b7f3-b0d7539f5735 for instance e8d4e170-63f9-4fa3-858f-9be84ff18613 on hv-cinder-84456 Oct 04 08:59:11.304466 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-ed3eaff9-7477-4a0c-974a-1e0ae81e53f1 req-8d4033a8-55c6-4405-a701-d1190c956efa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030588 Oct 04 08:59:11.305290 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 433/820] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:11.643552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-cffb7282-3df8-4f62-9793-d5d4fbe02143 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:11.645148 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-cffb7282-3df8-4f62-9793-d5d4fbe02143 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:11.651989 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cffb7282-3df8-4f62-9793-d5d4fbe02143 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:11.652479 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cffb7282-3df8-4f62-9793-d5d4fbe02143 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:11.652960 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cffb7282-3df8-4f62-9793-d5d4fbe02143 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:11.653640 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cffb7282-3df8-4f62-9793-d5d4fbe02143 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:11.654261 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cffb7282-3df8-4f62-9793-d5d4fbe02143 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:11.654682 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cffb7282-3df8-4f62-9793-d5d4fbe02143 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:11.796683 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-cffb7282-3df8-4f62-9793-d5d4fbe02143 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:11.805896 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-cffb7282-3df8-4f62-9793-d5d4fbe02143 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:11.807326 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-cffb7282-3df8-4f62-9793-d5d4fbe02143 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:11.809014 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-cffb7282-3df8-4f62-9793-d5d4fbe02143 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1406 microversion: 2.20 time: 0.169392 Oct 04 08:59:11.809146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 388/821] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:11 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:12.102380 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-951e616d-e72d-4c0f-9a06-bbca07abc65f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:12.104233 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-951e616d-e72d-4c0f-9a06-bbca07abc65f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:12.110814 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-951e616d-e72d-4c0f-9a06-bbca07abc65f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:12.111227 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-951e616d-e72d-4c0f-9a06-bbca07abc65f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:12.111656 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-951e616d-e72d-4c0f-9a06-bbca07abc65f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:12.112377 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-951e616d-e72d-4c0f-9a06-bbca07abc65f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:12.112832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-951e616d-e72d-4c0f-9a06-bbca07abc65f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:12.113252 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-951e616d-e72d-4c0f-9a06-bbca07abc65f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:12.255772 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-951e616d-e72d-4c0f-9a06-bbca07abc65f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:12.264726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-951e616d-e72d-4c0f-9a06-bbca07abc65f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.166596 Oct 04 08:59:12.265439 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 434/822] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:12 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:12.724639 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-74d2364e-cc7b-4206-b653-03b8c54a681a req-f54bc880-2327-40d3-aaaf-e93e94345820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92654e2b-1d8a-4564-8a00-e659b6ae6ec9", "tag": "f2362281-c90c-4e3f-bb88-2c03bca5bd71"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:12.735399 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-74d2364e-cc7b-4206-b653-03b8c54a681a req-f54bc880-2327-40d3-aaaf-e93e94345820 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:12.736039 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-74d2364e-cc7b-4206-b653-03b8c54a681a req-f54bc880-2327-40d3-aaaf-e93e94345820 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:12.736466 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-74d2364e-cc7b-4206-b653-03b8c54a681a req-f54bc880-2327-40d3-aaaf-e93e94345820 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:12.748493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-74d2364e-cc7b-4206-b653-03b8c54a681a req-f54bc880-2327-40d3-aaaf-e93e94345820 service nova] Creating event network-changed:f2362281-c90c-4e3f-bb88-2c03bca5bd71 for instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 on hv-cinder-84456 Oct 04 08:59:12.753795 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-74d2364e-cc7b-4206-b653-03b8c54a681a req-f54bc880-2327-40d3-aaaf-e93e94345820 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032735 Oct 04 08:59:12.754386 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 389/823] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:12.834055 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-57b665f6-4056-46d1-9bfe-0b5d9c927129 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:12.834656 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-57b665f6-4056-46d1-9bfe-0b5d9c927129 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:12.841104 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-57b665f6-4056-46d1-9bfe-0b5d9c927129 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:12.841587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-57b665f6-4056-46d1-9bfe-0b5d9c927129 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:12.842010 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-57b665f6-4056-46d1-9bfe-0b5d9c927129 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:12.842799 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-57b665f6-4056-46d1-9bfe-0b5d9c927129 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:12.843242 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-57b665f6-4056-46d1-9bfe-0b5d9c927129 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:12.843656 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-57b665f6-4056-46d1-9bfe-0b5d9c927129 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:12.976384 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-57b665f6-4056-46d1-9bfe-0b5d9c927129 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:12.984828 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-57b665f6-4056-46d1-9bfe-0b5d9c927129 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:12.986503 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-57b665f6-4056-46d1-9bfe-0b5d9c927129 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:12.987592 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-57b665f6-4056-46d1-9bfe-0b5d9c927129 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1406 microversion: 2.20 time: 0.157573 Oct 04 08:59:12.988192 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 435/824] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:12 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:13.293333 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b9b3c16d-2e77-41a4-a8f8-7dc38f996299 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:13.294476 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b9b3c16d-2e77-41a4-a8f8-7dc38f996299 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:13.304960 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9b3c16d-2e77-41a4-a8f8-7dc38f996299 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:13.305754 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9b3c16d-2e77-41a4-a8f8-7dc38f996299 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:13.306487 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9b3c16d-2e77-41a4-a8f8-7dc38f996299 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:13.307619 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9b3c16d-2e77-41a4-a8f8-7dc38f996299 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:13.308426 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9b3c16d-2e77-41a4-a8f8-7dc38f996299 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:13.309223 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9b3c16d-2e77-41a4-a8f8-7dc38f996299 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:13.441848 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b9b3c16d-2e77-41a4-a8f8-7dc38f996299 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:13.452478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b9b3c16d-2e77-41a4-a8f8-7dc38f996299 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.166172 Oct 04 08:59:13.453075 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 390/825] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:13 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:59:14.012452 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ef894b8c-87de-44dc-ba07-0857afa28fe7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:14.013083 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ef894b8c-87de-44dc-ba07-0857afa28fe7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:14.015605 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:14.021797 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef894b8c-87de-44dc-ba07-0857afa28fe7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:14.022337 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef894b8c-87de-44dc-ba07-0857afa28fe7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:14.022776 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef894b8c-87de-44dc-ba07-0857afa28fe7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:14.023466 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef894b8c-87de-44dc-ba07-0857afa28fe7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:14.023909 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef894b8c-87de-44dc-ba07-0857afa28fe7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:14.024359 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef894b8c-87de-44dc-ba07-0857afa28fe7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:14.158708 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ef894b8c-87de-44dc-ba07-0857afa28fe7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:14.167701 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ef894b8c-87de-44dc-ba07-0857afa28fe7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:14.169238 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ef894b8c-87de-44dc-ba07-0857afa28fe7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:14.170387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ef894b8c-87de-44dc-ba07-0857afa28fe7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1406 microversion: 2.20 time: 0.161921 Oct 04 08:59:14.170946 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 436/826] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:14 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:14.316289 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6bb8d91c-004e-402c-8e75-eb2be02e9cac tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:14.317104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6bb8d91c-004e-402c-8e75-eb2be02e9cac tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:14.324263 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6bb8d91c-004e-402c-8e75-eb2be02e9cac tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:14.324814 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6bb8d91c-004e-402c-8e75-eb2be02e9cac tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:14.325237 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6bb8d91c-004e-402c-8e75-eb2be02e9cac tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:14.325918 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6bb8d91c-004e-402c-8e75-eb2be02e9cac tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:14.326361 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6bb8d91c-004e-402c-8e75-eb2be02e9cac tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:14.326782 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6bb8d91c-004e-402c-8e75-eb2be02e9cac tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:14.463705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6bb8d91c-004e-402c-8e75-eb2be02e9cac tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:14.474452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6bb8d91c-004e-402c-8e75-eb2be02e9cac tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1595 microversion: 2.1 time: 0.164534 Oct 04 08:59:14.475000 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 391/827] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:14 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1595 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:14.476076 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-26aa6b4d-d23a-4095-9499-d44356c24896 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:14.476666 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-26aa6b4d-d23a-4095-9499-d44356c24896 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:14.482895 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-26aa6b4d-d23a-4095-9499-d44356c24896 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:14.483451 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-26aa6b4d-d23a-4095-9499-d44356c24896 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:14.483914 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-26aa6b4d-d23a-4095-9499-d44356c24896 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:14.484607 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-26aa6b4d-d23a-4095-9499-d44356c24896 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:14.485038 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-26aa6b4d-d23a-4095-9499-d44356c24896 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:14.485502 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-26aa6b4d-d23a-4095-9499-d44356c24896 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:14.620747 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-26aa6b4d-d23a-4095-9499-d44356c24896 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:14.628749 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-26aa6b4d-d23a-4095-9499-d44356c24896 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.156538 Oct 04 08:59:14.629296 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 437/828] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:14 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:59:15.196213 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-aca972aa-997b-43a9-bc48-2af6768dde1e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:15.197204 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-aca972aa-997b-43a9-bc48-2af6768dde1e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:15.204709 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aca972aa-997b-43a9-bc48-2af6768dde1e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:15.205454 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aca972aa-997b-43a9-bc48-2af6768dde1e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:15.205894 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aca972aa-997b-43a9-bc48-2af6768dde1e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:15.206585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aca972aa-997b-43a9-bc48-2af6768dde1e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:15.207032 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aca972aa-997b-43a9-bc48-2af6768dde1e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:15.207453 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aca972aa-997b-43a9-bc48-2af6768dde1e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:15.336522 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-aca972aa-997b-43a9-bc48-2af6768dde1e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:15.344751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-aca972aa-997b-43a9-bc48-2af6768dde1e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:15.346222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-aca972aa-997b-43a9-bc48-2af6768dde1e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:15.347377 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-aca972aa-997b-43a9-bc48-2af6768dde1e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1406 microversion: 2.20 time: 0.155642 Oct 04 08:59:15.347949 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 392/829] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:15 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:15.654009 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-65d7c377-4ce4-474c-898b-cb438610240f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:15.654759 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-65d7c377-4ce4-474c-898b-cb438610240f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:15.661236 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65d7c377-4ce4-474c-898b-cb438610240f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:15.661954 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65d7c377-4ce4-474c-898b-cb438610240f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:15.662540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65d7c377-4ce4-474c-898b-cb438610240f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:15.663438 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65d7c377-4ce4-474c-898b-cb438610240f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:15.663938 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65d7c377-4ce4-474c-898b-cb438610240f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:15.664348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65d7c377-4ce4-474c-898b-cb438610240f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:15.794245 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-65d7c377-4ce4-474c-898b-cb438610240f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:15.804121 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-65d7c377-4ce4-474c-898b-cb438610240f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.155075 Oct 04 08:59:15.804975 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 438/830] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:15 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:16.374258 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-bcf04fc3-946c-466b-a189-64c3da079e55 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:16.374980 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-bcf04fc3-946c-466b-a189-64c3da079e55 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:16.381904 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bcf04fc3-946c-466b-a189-64c3da079e55 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:16.382460 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bcf04fc3-946c-466b-a189-64c3da079e55 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:16.382959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bcf04fc3-946c-466b-a189-64c3da079e55 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:16.383737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bcf04fc3-946c-466b-a189-64c3da079e55 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:16.384428 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bcf04fc3-946c-466b-a189-64c3da079e55 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:16.384911 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bcf04fc3-946c-466b-a189-64c3da079e55 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:16.419507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-8d7a2ed2-6869-4e03-938d-5d9cf70a13be req-21a85654-15da-4bb4-a607-bb2f1a892bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5d6881-b38b-43b8-91c1-84e3e1338d9f", "tag": "7964acdb-66e8-472d-b77c-526ae4282bc9"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:16.428829 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-8d7a2ed2-6869-4e03-938d-5d9cf70a13be req-21a85654-15da-4bb4-a607-bb2f1a892bc5 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:16.429302 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-8d7a2ed2-6869-4e03-938d-5d9cf70a13be req-21a85654-15da-4bb4-a607-bb2f1a892bc5 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:16.429725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-8d7a2ed2-6869-4e03-938d-5d9cf70a13be req-21a85654-15da-4bb4-a607-bb2f1a892bc5 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:16.441477 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-8d7a2ed2-6869-4e03-938d-5d9cf70a13be req-21a85654-15da-4bb4-a607-bb2f1a892bc5 service nova] Creating event network-changed:7964acdb-66e8-472d-b77c-526ae4282bc9 for instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f on hv-cinder-84456 Oct 04 08:59:16.446764 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-8d7a2ed2-6869-4e03-938d-5d9cf70a13be req-21a85654-15da-4bb4-a607-bb2f1a892bc5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030883 Oct 04 08:59:16.447359 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 439/831] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:16.561984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-bcf04fc3-946c-466b-a189-64c3da079e55 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:16.575057 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-bcf04fc3-946c-466b-a189-64c3da079e55 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:16.577135 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-bcf04fc3-946c-466b-a189-64c3da079e55 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:16.578495 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-bcf04fc3-946c-466b-a189-64c3da079e55 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1406 microversion: 2.20 time: 0.209284 Oct 04 08:59:16.579429 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 393/832] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:16 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:16.828608 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f4d44a94-07b9-4406-a255-1c40b00b5356 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:16.829168 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f4d44a94-07b9-4406-a255-1c40b00b5356 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:16.835481 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4d44a94-07b9-4406-a255-1c40b00b5356 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:16.836233 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4d44a94-07b9-4406-a255-1c40b00b5356 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:16.836631 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4d44a94-07b9-4406-a255-1c40b00b5356 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:16.837555 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4d44a94-07b9-4406-a255-1c40b00b5356 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:16.837966 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4d44a94-07b9-4406-a255-1c40b00b5356 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:16.838383 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4d44a94-07b9-4406-a255-1c40b00b5356 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:17.000073 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f4d44a94-07b9-4406-a255-1c40b00b5356 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:17.008193 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f4d44a94-07b9-4406-a255-1c40b00b5356 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.184613 Oct 04 08:59:17.008859 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 440/833] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:16 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:17.606215 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-34ba0794-4ec3-425e-88fd-98bfe285ce1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:17.606835 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-34ba0794-4ec3-425e-88fd-98bfe285ce1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:17.613323 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-34ba0794-4ec3-425e-88fd-98bfe285ce1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:17.613809 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-34ba0794-4ec3-425e-88fd-98bfe285ce1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:17.614244 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-34ba0794-4ec3-425e-88fd-98bfe285ce1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:17.615185 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-34ba0794-4ec3-425e-88fd-98bfe285ce1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:17.619236 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-34ba0794-4ec3-425e-88fd-98bfe285ce1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:17.620451 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-34ba0794-4ec3-425e-88fd-98bfe285ce1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:17.758889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-34ba0794-4ec3-425e-88fd-98bfe285ce1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:17.767972 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-34ba0794-4ec3-425e-88fd-98bfe285ce1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:17.769637 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-34ba0794-4ec3-425e-88fd-98bfe285ce1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:17.770772 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-34ba0794-4ec3-425e-88fd-98bfe285ce1d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1406 microversion: 2.20 time: 0.169358 Oct 04 08:59:17.771325 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 394/834] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:17 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:17.775773 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-17e5eba8-e3c6-4255-ba2a-97563361b716 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1424633393"}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:17.776585 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-17e5eba8-e3c6-4255-ba2a-97563361b716 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:17.782724 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17e5eba8-e3c6-4255-ba2a-97563361b716 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:17.783285 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17e5eba8-e3c6-4255-ba2a-97563361b716 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:17.783804 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17e5eba8-e3c6-4255-ba2a-97563361b716 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:17.784577 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17e5eba8-e3c6-4255-ba2a-97563361b716 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:17.785087 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17e5eba8-e3c6-4255-ba2a-97563361b716 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:17.785568 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17e5eba8-e3c6-4255-ba2a-97563361b716 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:17.916324 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.network.security_group_api [None req-17e5eba8-e3c6-4255-ba2a-97563361b716 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Adding security group 46f0e86a-2649-4bd2-bfa8-07274ad48d52 to port 7964acdb-66e8-472d-b77c-526ae4282bc9 Oct 04 08:59:18.031130 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-aaf68ef2-bede-47cc-b255-1778b36c68e8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:18.031860 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-aaf68ef2-bede-47cc-b255-1778b36c68e8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:18.038100 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aaf68ef2-bede-47cc-b255-1778b36c68e8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:18.038680 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aaf68ef2-bede-47cc-b255-1778b36c68e8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:18.039184 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aaf68ef2-bede-47cc-b255-1778b36c68e8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:18.039967 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aaf68ef2-bede-47cc-b255-1778b36c68e8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:18.040486 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aaf68ef2-bede-47cc-b255-1778b36c68e8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:18.040982 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-aaf68ef2-bede-47cc-b255-1778b36c68e8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:18.242073 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-aaf68ef2-bede-47cc-b255-1778b36c68e8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:18.250393 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-aaf68ef2-bede-47cc-b255-1778b36c68e8 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.223301 Oct 04 08:59:18.251108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 395/835] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:18 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:18.316825 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-17e5eba8-e3c6-4255-ba2a-97563361b716 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "POST /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/action" status: 202 len: 0 microversion: 2.1 time: 0.547324 Oct 04 08:59:18.320526 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 441/836] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Oct 4 08:59:17 2022] POST /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 08:59:18.325760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-918c0130-37d5-4ecb-8534-7c5fb8b570a2 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:18.326385 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-918c0130-37d5-4ecb-8534-7c5fb8b570a2 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:18.333089 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-918c0130-37d5-4ecb-8534-7c5fb8b570a2 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:18.333577 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-918c0130-37d5-4ecb-8534-7c5fb8b570a2 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:18.334008 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-918c0130-37d5-4ecb-8534-7c5fb8b570a2 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:18.334701 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-918c0130-37d5-4ecb-8534-7c5fb8b570a2 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:18.335280 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-918c0130-37d5-4ecb-8534-7c5fb8b570a2 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:18.335706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-918c0130-37d5-4ecb-8534-7c5fb8b570a2 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:18.343085 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-bd350332-023a-45f4-aee3-1706c95eb240 req-e89eade5-1783-4a19-87bc-9d52d989c6cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5d6881-b38b-43b8-91c1-84e3e1338d9f", "tag": "7964acdb-66e8-472d-b77c-526ae4282bc9"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:18.357062 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-bd350332-023a-45f4-aee3-1706c95eb240 req-e89eade5-1783-4a19-87bc-9d52d989c6cc service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:18.357935 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-bd350332-023a-45f4-aee3-1706c95eb240 req-e89eade5-1783-4a19-87bc-9d52d989c6cc service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:18.358588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-bd350332-023a-45f4-aee3-1706c95eb240 req-e89eade5-1783-4a19-87bc-9d52d989c6cc service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:18.373280 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-bd350332-023a-45f4-aee3-1706c95eb240 req-e89eade5-1783-4a19-87bc-9d52d989c6cc service nova] Creating event network-changed:7964acdb-66e8-472d-b77c-526ae4282bc9 for instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f on hv-cinder-84456 Oct 04 08:59:18.378163 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-bd350332-023a-45f4-aee3-1706c95eb240 req-e89eade5-1783-4a19-87bc-9d52d989c6cc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039079 Oct 04 08:59:18.378754 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 442/837] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:18.498152 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-918c0130-37d5-4ecb-8534-7c5fb8b570a2 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:18.506580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-918c0130-37d5-4ecb-8534-7c5fb8b570a2 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1761 microversion: 2.1 time: 0.184927 Oct 04 08:59:18.507157 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 396/838] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:18 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1761 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:59:18.796316 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0a60e371-31bd-4ec4-a909-9746e161b76c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:18.797003 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0a60e371-31bd-4ec4-a909-9746e161b76c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:18.803175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a60e371-31bd-4ec4-a909-9746e161b76c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:18.803628 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a60e371-31bd-4ec4-a909-9746e161b76c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:18.804089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a60e371-31bd-4ec4-a909-9746e161b76c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:18.804771 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a60e371-31bd-4ec4-a909-9746e161b76c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:18.805216 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a60e371-31bd-4ec4-a909-9746e161b76c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:18.805638 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a60e371-31bd-4ec4-a909-9746e161b76c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:18.943837 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0a60e371-31bd-4ec4-a909-9746e161b76c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:18.952654 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0a60e371-31bd-4ec4-a909-9746e161b76c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:18.954208 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0a60e371-31bd-4ec4-a909-9746e161b76c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:18.955395 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0a60e371-31bd-4ec4-a909-9746e161b76c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1406 microversion: 2.20 time: 0.163661 Oct 04 08:59:18.956040 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 443/839] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:18 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:19.274605 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9bb00b26-4e6b-4aa7-82b9-02988994af26 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:19.275183 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9bb00b26-4e6b-4aa7-82b9-02988994af26 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:19.282243 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9bb00b26-4e6b-4aa7-82b9-02988994af26 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:19.282727 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9bb00b26-4e6b-4aa7-82b9-02988994af26 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:19.283162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9bb00b26-4e6b-4aa7-82b9-02988994af26 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:19.283851 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9bb00b26-4e6b-4aa7-82b9-02988994af26 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:19.284332 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9bb00b26-4e6b-4aa7-82b9-02988994af26 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:19.284734 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9bb00b26-4e6b-4aa7-82b9-02988994af26 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:19.314667 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:19.337380 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=6 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:19.420917 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9bb00b26-4e6b-4aa7-82b9-02988994af26 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:19.429000 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9bb00b26-4e6b-4aa7-82b9-02988994af26 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.158398 Oct 04 08:59:19.429584 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 397/840] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:19 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:19.935990 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-df7cb195-de38-4793-979f-7c7540295d35 req-03345561-1997-471b-a6f1-65f6e9286846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92654e2b-1d8a-4564-8a00-e659b6ae6ec9", "name": "network-vif-plugged", "status": "completed", "tag": "f2362281-c90c-4e3f-bb88-2c03bca5bd71"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:19.941036 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=6 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:19.947297 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-df7cb195-de38-4793-979f-7c7540295d35 req-03345561-1997-471b-a6f1-65f6e9286846 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:19.947962 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-df7cb195-de38-4793-979f-7c7540295d35 req-03345561-1997-471b-a6f1-65f6e9286846 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:19.948199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-df7cb195-de38-4793-979f-7c7540295d35 req-03345561-1997-471b-a6f1-65f6e9286846 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:19.959913 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-df7cb195-de38-4793-979f-7c7540295d35 req-03345561-1997-471b-a6f1-65f6e9286846 service nova] Creating event network-vif-plugged:f2362281-c90c-4e3f-bb88-2c03bca5bd71 for instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 on hv-cinder-84456 Oct 04 08:59:19.965970 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-df7cb195-de38-4793-979f-7c7540295d35 req-03345561-1997-471b-a6f1-65f6e9286846 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033347 Oct 04 08:59:19.966807 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 444/841] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:19.982330 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-cd73b2be-38cb-4162-a189-96ddac62e346 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:19.983069 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-cd73b2be-38cb-4162-a189-96ddac62e346 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:19.989275 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cd73b2be-38cb-4162-a189-96ddac62e346 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:19.989862 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cd73b2be-38cb-4162-a189-96ddac62e346 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:19.990362 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cd73b2be-38cb-4162-a189-96ddac62e346 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:19.991124 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cd73b2be-38cb-4162-a189-96ddac62e346 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:19.991998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cd73b2be-38cb-4162-a189-96ddac62e346 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:19.992492 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cd73b2be-38cb-4162-a189-96ddac62e346 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:20.134958 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-cd73b2be-38cb-4162-a189-96ddac62e346 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:20.143162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-cd73b2be-38cb-4162-a189-96ddac62e346 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:20.144648 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-cd73b2be-38cb-4162-a189-96ddac62e346 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:20.145769 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-cd73b2be-38cb-4162-a189-96ddac62e346 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1406 microversion: 2.20 time: 0.167606 Oct 04 08:59:20.146334 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 398/842] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:19 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:59:20.453170 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7e9dfb6d-2e58-4a25-a47b-ad0b3db0bf43 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:20.453974 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7e9dfb6d-2e58-4a25-a47b-ad0b3db0bf43 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:20.460577 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7e9dfb6d-2e58-4a25-a47b-ad0b3db0bf43 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:20.461040 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7e9dfb6d-2e58-4a25-a47b-ad0b3db0bf43 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:20.461479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7e9dfb6d-2e58-4a25-a47b-ad0b3db0bf43 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:20.462160 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7e9dfb6d-2e58-4a25-a47b-ad0b3db0bf43 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:20.462606 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7e9dfb6d-2e58-4a25-a47b-ad0b3db0bf43 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:20.463023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7e9dfb6d-2e58-4a25-a47b-ad0b3db0bf43 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:20.593174 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7e9dfb6d-2e58-4a25-a47b-ad0b3db0bf43 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:20.605173 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7e9dfb6d-2e58-4a25-a47b-ad0b3db0bf43 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.156353 Oct 04 08:59:20.606020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 445/843] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:20 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:21.175966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a65e41e5-720b-4daa-b296-657be0ccd20e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:21.177121 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a65e41e5-720b-4daa-b296-657be0ccd20e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:21.188434 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a65e41e5-720b-4daa-b296-657be0ccd20e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:21.188970 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a65e41e5-720b-4daa-b296-657be0ccd20e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:21.189812 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a65e41e5-720b-4daa-b296-657be0ccd20e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:21.190938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a65e41e5-720b-4daa-b296-657be0ccd20e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:21.191687 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a65e41e5-720b-4daa-b296-657be0ccd20e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:21.192439 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a65e41e5-720b-4daa-b296-657be0ccd20e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:21.324930 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a65e41e5-720b-4daa-b296-657be0ccd20e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:21.333050 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a65e41e5-720b-4daa-b296-657be0ccd20e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:21.334463 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a65e41e5-720b-4daa-b296-657be0ccd20e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:21.335555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a65e41e5-720b-4daa-b296-657be0ccd20e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1406 microversion: 2.20 time: 0.166877 Oct 04 08:59:21.336117 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 399/844] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:21 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:21.633141 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ef0a5806-3da8-4826-b130-b8c91c2f309a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:21.634075 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ef0a5806-3da8-4826-b130-b8c91c2f309a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:21.638059 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:21.646775 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef0a5806-3da8-4826-b130-b8c91c2f309a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:21.647557 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef0a5806-3da8-4826-b130-b8c91c2f309a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:21.648328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef0a5806-3da8-4826-b130-b8c91c2f309a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:21.649624 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef0a5806-3da8-4826-b130-b8c91c2f309a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:21.650395 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef0a5806-3da8-4826-b130-b8c91c2f309a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:21.651135 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef0a5806-3da8-4826-b130-b8c91c2f309a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:21.792344 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ef0a5806-3da8-4826-b130-b8c91c2f309a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:21.800824 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ef0a5806-3da8-4826-b130-b8c91c2f309a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.174259 Oct 04 08:59:21.801390 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 446/845] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:21 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:22.364852 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5e42ffa0-803b-415d-9d9d-4db8c3d917a7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:22.365943 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5e42ffa0-803b-415d-9d9d-4db8c3d917a7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:22.375194 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5e42ffa0-803b-415d-9d9d-4db8c3d917a7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:22.375675 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5e42ffa0-803b-415d-9d9d-4db8c3d917a7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:22.376156 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5e42ffa0-803b-415d-9d9d-4db8c3d917a7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:22.376840 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5e42ffa0-803b-415d-9d9d-4db8c3d917a7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:22.377285 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5e42ffa0-803b-415d-9d9d-4db8c3d917a7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:22.377698 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5e42ffa0-803b-415d-9d9d-4db8c3d917a7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:22.511495 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5e42ffa0-803b-415d-9d9d-4db8c3d917a7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:22.519690 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5e42ffa0-803b-415d-9d9d-4db8c3d917a7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:22.521181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5e42ffa0-803b-415d-9d9d-4db8c3d917a7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:22.522339 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5e42ffa0-803b-415d-9d9d-4db8c3d917a7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1597 microversion: 2.20 time: 0.164215 Oct 04 08:59:22.522944 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 400/846] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:22 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1597 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:22.546865 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-802fcbdd-deb4-4d70-a7ba-f7f560d01a68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:22.547354 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-802fcbdd-deb4-4d70-a7ba-f7f560d01a68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:22.553953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-802fcbdd-deb4-4d70-a7ba-f7f560d01a68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:22.554436 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-802fcbdd-deb4-4d70-a7ba-f7f560d01a68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:22.554862 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-802fcbdd-deb4-4d70-a7ba-f7f560d01a68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:22.555550 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-802fcbdd-deb4-4d70-a7ba-f7f560d01a68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:22.556039 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-802fcbdd-deb4-4d70-a7ba-f7f560d01a68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:22.556457 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-802fcbdd-deb4-4d70-a7ba-f7f560d01a68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:22.641200 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-802fcbdd-deb4-4d70-a7ba-f7f560d01a68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098051 Oct 04 08:59:22.641828 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 447/847] 10.222.0.44 () {60 vars in 1316 bytes} [Tue Oct 4 08:59:22 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 08:59:22.824540 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4431a677-9fc0-42bb-bed3-b8b26cc23a7f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:22.825256 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4431a677-9fc0-42bb-bed3-b8b26cc23a7f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:22.831660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4431a677-9fc0-42bb-bed3-b8b26cc23a7f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:22.832194 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4431a677-9fc0-42bb-bed3-b8b26cc23a7f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:22.832635 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4431a677-9fc0-42bb-bed3-b8b26cc23a7f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:22.833334 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4431a677-9fc0-42bb-bed3-b8b26cc23a7f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:22.833791 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4431a677-9fc0-42bb-bed3-b8b26cc23a7f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:22.834218 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4431a677-9fc0-42bb-bed3-b8b26cc23a7f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:23.076768 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4431a677-9fc0-42bb-bed3-b8b26cc23a7f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:23.085008 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4431a677-9fc0-42bb-bed3-b8b26cc23a7f tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1677 microversion: 2.1 time: 0.264430 Oct 04 08:59:23.085832 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 401/848] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:22 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1677 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:23.908198 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-b859e9d4-0166-4df1-8ae2-3bd091c64853 req-94cdfbab-5709-4a59-8186-2cf18b05e65c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92654e2b-1d8a-4564-8a00-e659b6ae6ec9", "tag": "f2362281-c90c-4e3f-bb88-2c03bca5bd71"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:23.917494 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-b859e9d4-0166-4df1-8ae2-3bd091c64853 req-94cdfbab-5709-4a59-8186-2cf18b05e65c service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:23.917959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-b859e9d4-0166-4df1-8ae2-3bd091c64853 req-94cdfbab-5709-4a59-8186-2cf18b05e65c service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:23.918407 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-b859e9d4-0166-4df1-8ae2-3bd091c64853 req-94cdfbab-5709-4a59-8186-2cf18b05e65c service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:23.929703 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-b859e9d4-0166-4df1-8ae2-3bd091c64853 req-94cdfbab-5709-4a59-8186-2cf18b05e65c service nova] Creating event network-changed:f2362281-c90c-4e3f-bb88-2c03bca5bd71 for instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 on hv-cinder-84456 Oct 04 08:59:23.934842 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-b859e9d4-0166-4df1-8ae2-3bd091c64853 req-94cdfbab-5709-4a59-8186-2cf18b05e65c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030821 Oct 04 08:59:23.935559 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 448/849] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:24.110240 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b85feb4e-99bd-461f-abce-6f9b379de323 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:24.111505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b85feb4e-99bd-461f-abce-6f9b379de323 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:24.120233 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b85feb4e-99bd-461f-abce-6f9b379de323 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:24.120976 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b85feb4e-99bd-461f-abce-6f9b379de323 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:24.121634 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b85feb4e-99bd-461f-abce-6f9b379de323 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:24.122565 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b85feb4e-99bd-461f-abce-6f9b379de323 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:24.123344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b85feb4e-99bd-461f-abce-6f9b379de323 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:24.124100 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b85feb4e-99bd-461f-abce-6f9b379de323 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:24.263103 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b85feb4e-99bd-461f-abce-6f9b379de323 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:24.271110 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b85feb4e-99bd-461f-abce-6f9b379de323 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1654 microversion: 2.1 time: 0.164971 Oct 04 08:59:24.271704 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 402/850] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:24 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1654 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:59:24.295998 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-22f59840-2db9-4a00-a5bc-994c208684e3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:24.303419 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-22f59840-2db9-4a00-a5bc-994c208684e3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:24.304057 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-22f59840-2db9-4a00-a5bc-994c208684e3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:24.304661 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-22f59840-2db9-4a00-a5bc-994c208684e3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:24.327910 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-22f59840-2db9-4a00-a5bc-994c208684e3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Going to try to start instance {{(pid=142438) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 08:59:24.353101 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:24.377231 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-22f59840-2db9-4a00-a5bc-994c208684e3 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "POST /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/action" status: 202 len: 0 microversion: 2.1 time: 0.085924 Oct 04 08:59:24.377846 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 449/851] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Oct 4 08:59:24 2022] POST /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:59:24.386952 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-dd490f25-7a77-44ac-ad12-06be9500b7fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:24.388110 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-dd490f25-7a77-44ac-ad12-06be9500b7fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:24.394419 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd490f25-7a77-44ac-ad12-06be9500b7fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:24.395142 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd490f25-7a77-44ac-ad12-06be9500b7fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:24.395743 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd490f25-7a77-44ac-ad12-06be9500b7fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:24.396987 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd490f25-7a77-44ac-ad12-06be9500b7fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:24.397652 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd490f25-7a77-44ac-ad12-06be9500b7fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:24.398304 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd490f25-7a77-44ac-ad12-06be9500b7fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:24.567462 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dd490f25-7a77-44ac-ad12-06be9500b7fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:24.570952 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=100 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:24.576524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-dd490f25-7a77-44ac-ad12-06be9500b7fd tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1663 microversion: 2.1 time: 0.193702 Oct 04 08:59:24.577363 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 403/852] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:24 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1663 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:25.606297 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-16c9be10-a481-41c6-8762-0e2c2c167796 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:25.606997 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-16c9be10-a481-41c6-8762-0e2c2c167796 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:25.613965 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16c9be10-a481-41c6-8762-0e2c2c167796 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:25.614467 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16c9be10-a481-41c6-8762-0e2c2c167796 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:25.614918 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16c9be10-a481-41c6-8762-0e2c2c167796 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:25.615630 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16c9be10-a481-41c6-8762-0e2c2c167796 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:25.616144 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16c9be10-a481-41c6-8762-0e2c2c167796 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:25.616931 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-16c9be10-a481-41c6-8762-0e2c2c167796 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:25.753972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-16c9be10-a481-41c6-8762-0e2c2c167796 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:25.763270 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-16c9be10-a481-41c6-8762-0e2c2c167796 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1663 microversion: 2.1 time: 0.164953 Oct 04 08:59:25.763854 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 450/853] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:25 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:26.791181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d112d4e8-2fa1-4486-b6bb-56bd91ccb8d0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:26.792237 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d112d4e8-2fa1-4486-b6bb-56bd91ccb8d0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:26.803192 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d112d4e8-2fa1-4486-b6bb-56bd91ccb8d0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:26.803969 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d112d4e8-2fa1-4486-b6bb-56bd91ccb8d0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:26.804730 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d112d4e8-2fa1-4486-b6bb-56bd91ccb8d0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:26.805866 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d112d4e8-2fa1-4486-b6bb-56bd91ccb8d0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:26.806617 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d112d4e8-2fa1-4486-b6bb-56bd91ccb8d0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:26.807324 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d112d4e8-2fa1-4486-b6bb-56bd91ccb8d0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:26.943222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d112d4e8-2fa1-4486-b6bb-56bd91ccb8d0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:26.951574 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d112d4e8-2fa1-4486-b6bb-56bd91ccb8d0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1667 microversion: 2.1 time: 0.167432 Oct 04 08:59:26.952196 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 404/854] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:26 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1667 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:01.362736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f6230cd6-a9d5-4138-b641-97aa5217ab73 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:01.363661 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f6230cd6-a9d5-4138-b641-97aa5217ab73 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:01.366043 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=9 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:01.366694 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=7,nova_cell1:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:01.372604 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f6230cd6-a9d5-4138-b641-97aa5217ab73 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:01.373083 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f6230cd6-a9d5-4138-b641-97aa5217ab73 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:01.373515 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f6230cd6-a9d5-4138-b641-97aa5217ab73 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:01.374204 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f6230cd6-a9d5-4138-b641-97aa5217ab73 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:01.374655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f6230cd6-a9d5-4138-b641-97aa5217ab73 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:01.375076 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f6230cd6-a9d5-4138-b641-97aa5217ab73 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:01.400731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f6230cd6-a9d5-4138-b641-97aa5217ab73 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Going to try to terminate instance {{(pid=142438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:00:01.490657 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f6230cd6-a9d5-4138-b641-97aa5217ab73 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 204 len: 0 microversion: 2.1 time: 0.134061 Oct 04 09:00:01.491506 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 451/855] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:00:01 2022] DELETE /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:00:01.501152 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d14c0ca2-d42c-4b4c-be78-948ecdc7c4e3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:01.501797 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d14c0ca2-d42c-4b4c-be78-948ecdc7c4e3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:01.504032 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:01.504710 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=6 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:01.511161 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d14c0ca2-d42c-4b4c-be78-948ecdc7c4e3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:01.511681 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d14c0ca2-d42c-4b4c-be78-948ecdc7c4e3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:01.512148 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d14c0ca2-d42c-4b4c-be78-948ecdc7c4e3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:01.512843 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d14c0ca2-d42c-4b4c-be78-948ecdc7c4e3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:01.513289 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d14c0ca2-d42c-4b4c-be78-948ecdc7c4e3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:01.513708 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d14c0ca2-d42c-4b4c-be78-948ecdc7c4e3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:01.650466 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d14c0ca2-d42c-4b4c-be78-948ecdc7c4e3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:01.662358 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d14c0ca2-d42c-4b4c-be78-948ecdc7c4e3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1573 microversion: 2.1 time: 0.165110 Oct 04 09:00:01.663130 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 405/856] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:01 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:00:02.691618 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2bd47a8a-2eb8-4069-980f-a1bcbe872738 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:02.692668 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2bd47a8a-2eb8-4069-980f-a1bcbe872738 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:02.700288 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2bd47a8a-2eb8-4069-980f-a1bcbe872738 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:02.700850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2bd47a8a-2eb8-4069-980f-a1bcbe872738 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:02.701287 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2bd47a8a-2eb8-4069-980f-a1bcbe872738 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:02.701990 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2bd47a8a-2eb8-4069-980f-a1bcbe872738 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:02.702473 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2bd47a8a-2eb8-4069-980f-a1bcbe872738 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:02.702946 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2bd47a8a-2eb8-4069-980f-a1bcbe872738 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:02.846741 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2bd47a8a-2eb8-4069-980f-a1bcbe872738 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:02.858657 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2bd47a8a-2eb8-4069-980f-a1bcbe872738 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1573 microversion: 2.1 time: 0.174080 Oct 04 09:00:02.859397 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 452/857] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:02 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:03.883475 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-74502009-ad97-47fc-b48e-ad35de87c4c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:03.884134 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-74502009-ad97-47fc-b48e-ad35de87c4c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:03.890665 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-74502009-ad97-47fc-b48e-ad35de87c4c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:03.891147 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-74502009-ad97-47fc-b48e-ad35de87c4c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:03.891583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-74502009-ad97-47fc-b48e-ad35de87c4c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:03.892306 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-74502009-ad97-47fc-b48e-ad35de87c4c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:03.892756 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-74502009-ad97-47fc-b48e-ad35de87c4c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:03.893223 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-74502009-ad97-47fc-b48e-ad35de87c4c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:04.031940 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-74502009-ad97-47fc-b48e-ad35de87c4c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:04.042467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-74502009-ad97-47fc-b48e-ad35de87c4c0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1573 microversion: 2.1 time: 0.162220 Oct 04 09:00:04.042467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 406/858] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:03 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:04.686980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-69fd3dc2-b106-4763-8097-1bcec40d0b31 req-aa917137-80a9-4443-9687-98b690134238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c126bbd8-579f-48ce-88d5-29b61bd75c28", "name": "network-vif-deleted", "tag": "aebd8c5b-67fa-48a2-be49-86c0fe14a590"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:04.699277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-69fd3dc2-b106-4763-8097-1bcec40d0b31 req-aa917137-80a9-4443-9687-98b690134238 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:04.699758 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-69fd3dc2-b106-4763-8097-1bcec40d0b31 req-aa917137-80a9-4443-9687-98b690134238 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:04.700214 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-69fd3dc2-b106-4763-8097-1bcec40d0b31 req-aa917137-80a9-4443-9687-98b690134238 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:04.714319 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-69fd3dc2-b106-4763-8097-1bcec40d0b31 req-aa917137-80a9-4443-9687-98b690134238 service nova] Creating event network-vif-deleted:aebd8c5b-67fa-48a2-be49-86c0fe14a590 for instance c126bbd8-579f-48ce-88d5-29b61bd75c28 on hv-cinder-84456 Oct 04 09:00:04.719631 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-69fd3dc2-b106-4763-8097-1bcec40d0b31 req-aa917137-80a9-4443-9687-98b690134238 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036353 Oct 04 09:00:04.720277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 453/859] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:05.065714 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-42992d9f-ef0a-401b-908c-0534c7343b2d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:05.066448 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-42992d9f-ef0a-401b-908c-0534c7343b2d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:05.073063 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-42992d9f-ef0a-401b-908c-0534c7343b2d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:05.073798 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-42992d9f-ef0a-401b-908c-0534c7343b2d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:05.074238 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-42992d9f-ef0a-401b-908c-0534c7343b2d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:05.074942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-42992d9f-ef0a-401b-908c-0534c7343b2d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:05.075386 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-42992d9f-ef0a-401b-908c-0534c7343b2d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:05.075831 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-42992d9f-ef0a-401b-908c-0534c7343b2d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:05.140418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-42992d9f-ef0a-401b-908c-0534c7343b2d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:05.149006 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-42992d9f-ef0a-401b-908c-0534c7343b2d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 200 len: 1225 microversion: 2.1 time: 0.087184 Oct 04 09:00:05.150320 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 407/860] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:05 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:06.174899 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1c0b95b3-1d7d-468d-b761-da292ce8aae3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:06.175718 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1c0b95b3-1d7d-468d-b761-da292ce8aae3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:06.182230 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1c0b95b3-1d7d-468d-b761-da292ce8aae3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:06.182710 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1c0b95b3-1d7d-468d-b761-da292ce8aae3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:06.183139 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1c0b95b3-1d7d-468d-b761-da292ce8aae3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:06.183830 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1c0b95b3-1d7d-468d-b761-da292ce8aae3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:06.185351 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1c0b95b3-1d7d-468d-b761-da292ce8aae3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:06.185351 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1c0b95b3-1d7d-468d-b761-da292ce8aae3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:06.199148 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-1c0b95b3-1d7d-468d-b761-da292ce8aae3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] HTTP exception thrown: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1c0b95b3-1d7d-468d-b761-da292ce8aae3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Request method failure captured: Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 HTTP/1.1 Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_TpG0P4hrI1_riDYCW34KMWgw3k8HzWWKQDWZN4OA7RwjFaVPPOlXJSC-4IxVkb5V0kx6OTMIVCK1VD-olX742a5fy61d1gJWzFSirdCfTUBSR7vb70g_ixOkSOfBAkkMSQxADOoP_L5-osTW9aLSB530f2shfykqfUZLOGXpEJtZI Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 881a40342cb84608b961e6b32dceadb4 Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-TestVolumeBootPattern-2116967592 Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:00:06.200849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:00:06.202261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_881a40342cb84608b961e6b32dceadb4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/881a40342cb84608b961e6b32dceadb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/881a40342cb84608b961e6b32dceadb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/881a40342cb84608b961e6b32dceadb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:00:06.202261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-TestVolumeBootPattern-2116967592 Oct 04 09:00:06.202261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 881a40342cb84608b961e6b32dceadb4 Oct 04 09:00:06.202261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116967592 Oct 04 09:00:06.202261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-TestVolumeBootPattern-2116967592-project Oct 04 09:00:06.202261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:00:06.202261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:00:06.202261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: d8d329978baf425e954b9965ae0cb652 Oct 04 09:00:06.202261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-TestVolumeBootPattern-2116967592-project Oct 04 09:00:06.202261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:00:06.202261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. Oct 04 09:00:06.202261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': 'c126bbd8-579f-48ce-88d5-29b61bd75c28'} Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:00:06.203074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. Oct 04 09:00:06.204725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:00:06.206015 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1c0b95b3-1d7d-468d-b761-da292ce8aae3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Returning 404 to user: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:00:06.206015 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1c0b95b3-1d7d-468d-b761-da292ce8aae3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 404 len: 111 microversion: 2.1 time: 0.033765 Oct 04 09:00:06.206015 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 454/861] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:06 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:00:06.328865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-614190951", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2035428488", "security_groups": [{"name": "tempest-secgroup-smoke-4569898"}], "block_device_mapping_v2": [{"uuid": "84b820f7-cf14-4bd9-aeb3-1608dc7d0384", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a2b42168-a300-492f-b1dd-1ff13847d44a"}]}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:06.462026 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.network.neutron [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] validate_networks() for [('a2b42168-a300-492f-b1dd-1ff13847d44a', None, None, None, None, None)] {{(pid=142439) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:00:06.860418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Flavor limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:00:06.861027 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Image limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:00:06.861725 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Flavor pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:00:06.862352 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Image pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:00:06.862919 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:00:06.873197 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:06.873682 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:06.874116 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:06.874839 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:06.875291 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:06.875713 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:06.892994 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Getting quotas for project 881a40342cb84608b961e6b32dceadb4. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:00:06.897507 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Getting quotas for user d8d329978baf425e954b9965ae0cb652 and project 881a40342cb84608b961e6b32dceadb4. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:00:06.961068 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Going to run 1 instances... {{(pid=142439) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:00:06.963288 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84b820f7-cf14-4bd9-aeb3-1608dc7d0384',volume_size=None,volume_type=None)] {{(pid=142439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:00:07.097544 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f2a65a74-c9e2-4c95-b736-69dec556411a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.778214 Oct 04 09:00:07.098199 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 408/862] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 09:00:06 2022] POST /compute/v2.1/servers => generated 403 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 09:00:07.109472 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-63db3940-18b2-4334-9e99-ca94e2927515 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:07.110008 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-63db3940-18b2-4334-9e99-ca94e2927515 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:07.163563 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-63db3940-18b2-4334-9e99-ca94e2927515 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:07.170469 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-63db3940-18b2-4334-9e99-ca94e2927515 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1094 microversion: 2.1 time: 0.064955 Oct 04 09:00:07.171704 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 455/863] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:07 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:08.199488 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-cbddc6e0-53d4-4082-ad0d-4d29157a9185 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:08.200692 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-cbddc6e0-53d4-4082-ad0d-4d29157a9185 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:08.210056 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cbddc6e0-53d4-4082-ad0d-4d29157a9185 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:08.210529 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cbddc6e0-53d4-4082-ad0d-4d29157a9185 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:08.210958 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cbddc6e0-53d4-4082-ad0d-4d29157a9185 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:08.211664 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cbddc6e0-53d4-4082-ad0d-4d29157a9185 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:08.212162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cbddc6e0-53d4-4082-ad0d-4d29157a9185 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:08.212580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cbddc6e0-53d4-4082-ad0d-4d29157a9185 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:08.279589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-cbddc6e0-53d4-4082-ad0d-4d29157a9185 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:08.287917 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-cbddc6e0-53d4-4082-ad0d-4d29157a9185 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1192 microversion: 2.1 time: 0.096189 Oct 04 09:00:08.288494 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 409/864] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:08 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:09.311627 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-89e9c69d-d9d5-4763-9145-df5e59e1e8cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:09.312376 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-89e9c69d-d9d5-4763-9145-df5e59e1e8cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:09.320170 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-89e9c69d-d9d5-4763-9145-df5e59e1e8cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:09.320896 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-89e9c69d-d9d5-4763-9145-df5e59e1e8cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:09.321336 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-89e9c69d-d9d5-4763-9145-df5e59e1e8cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:09.322036 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-89e9c69d-d9d5-4763-9145-df5e59e1e8cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:09.322488 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-89e9c69d-d9d5-4763-9145-df5e59e1e8cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:09.322908 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-89e9c69d-d9d5-4763-9145-df5e59e1e8cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:09.479816 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-89e9c69d-d9d5-4763-9145-df5e59e1e8cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:09.487850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-89e9c69d-d9d5-4763-9145-df5e59e1e8cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1275 microversion: 2.1 time: 0.180127 Oct 04 09:00:09.488453 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 456/865] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:09 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1275 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:09.871941 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-933ac776-7142-4203-a443-e931f0bb5af3 req-cb871f63-4240-4ebd-ab58-6b3dd4181f61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61244f16-1483-4d31-a6de-0d4689a62479", "tag": "ad67ba62-fb95-40fd-bf8f-f28d45c2e22f"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:09.882209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-933ac776-7142-4203-a443-e931f0bb5af3 req-cb871f63-4240-4ebd-ab58-6b3dd4181f61 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:09.882766 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-933ac776-7142-4203-a443-e931f0bb5af3 req-cb871f63-4240-4ebd-ab58-6b3dd4181f61 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:09.883343 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-933ac776-7142-4203-a443-e931f0bb5af3 req-cb871f63-4240-4ebd-ab58-6b3dd4181f61 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:09.894371 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-933ac776-7142-4203-a443-e931f0bb5af3 req-cb871f63-4240-4ebd-ab58-6b3dd4181f61 service nova] Creating event network-changed:ad67ba62-fb95-40fd-bf8f-f28d45c2e22f for instance 61244f16-1483-4d31-a6de-0d4689a62479 on hv-cinder-84456 Oct 04 09:00:09.899585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-933ac776-7142-4203-a443-e931f0bb5af3 req-cb871f63-4240-4ebd-ab58-6b3dd4181f61 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031432 Oct 04 09:00:09.900406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 410/866] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:10.588163 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8044891b-f741-4143-9c0f-52b26158ed8b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:10.588780 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8044891b-f741-4143-9c0f-52b26158ed8b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:10.594973 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8044891b-f741-4143-9c0f-52b26158ed8b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:10.595451 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8044891b-f741-4143-9c0f-52b26158ed8b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:10.595878 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8044891b-f741-4143-9c0f-52b26158ed8b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:10.596600 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8044891b-f741-4143-9c0f-52b26158ed8b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:10.597068 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8044891b-f741-4143-9c0f-52b26158ed8b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:10.597467 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8044891b-f741-4143-9c0f-52b26158ed8b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:10.736712 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8044891b-f741-4143-9c0f-52b26158ed8b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:10.745015 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8044891b-f741-4143-9c0f-52b26158ed8b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1263 microversion: 2.1 time: 0.235861 Oct 04 09:00:10.745584 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 457/867] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:10 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1263 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:11.769041 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6c55b653-1454-42fe-8ffb-b5df93685847 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:11.769735 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6c55b653-1454-42fe-8ffb-b5df93685847 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:11.776134 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c55b653-1454-42fe-8ffb-b5df93685847 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:11.776615 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c55b653-1454-42fe-8ffb-b5df93685847 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:11.777044 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c55b653-1454-42fe-8ffb-b5df93685847 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:11.777731 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c55b653-1454-42fe-8ffb-b5df93685847 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:11.778175 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c55b653-1454-42fe-8ffb-b5df93685847 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:11.778596 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c55b653-1454-42fe-8ffb-b5df93685847 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:11.926118 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6c55b653-1454-42fe-8ffb-b5df93685847 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:11.934414 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6c55b653-1454-42fe-8ffb-b5df93685847 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1263 microversion: 2.1 time: 0.170141 Oct 04 09:00:11.934986 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 411/868] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:11 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:12.565960 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-650e8c05-4008-48f9-b430-e15b8b5a5ff9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:12.566482 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-650e8c05-4008-48f9-b430-e15b8b5a5ff9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:12.573350 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-650e8c05-4008-48f9-b430-e15b8b5a5ff9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:12.573836 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-650e8c05-4008-48f9-b430-e15b8b5a5ff9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:12.574269 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-650e8c05-4008-48f9-b430-e15b8b5a5ff9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:12.574951 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-650e8c05-4008-48f9-b430-e15b8b5a5ff9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:12.575371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-650e8c05-4008-48f9-b430-e15b8b5a5ff9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:12.575787 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-650e8c05-4008-48f9-b430-e15b8b5a5ff9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:12.665117 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-650e8c05-4008-48f9-b430-e15b8b5a5ff9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lazy-loading 'services' on Instance uuid e8d4e170-63f9-4fa3-858f-9be84ff18613 {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:00:12.745673 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-650e8c05-4008-48f9-b430-e15b8b5a5ff9 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/os-volume_attachments/ad04fac4-3f96-4fa6-9e49-30fdcf77be97" status: 202 len: 0 microversion: 2.1 time: 0.183295 Oct 04 09:00:12.746282 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 458/869] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Oct 4 09:00:12 2022] DELETE /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/os-volume_attachments/ad04fac4-3f96-4fa6-9e49-30fdcf77be97 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:00:12.755468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ec99c0d5-6ddb-4a8d-ad5a-07c1074099d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:12.757813 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ec99c0d5-6ddb-4a8d-ad5a-07c1074099d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:12.765022 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ec99c0d5-6ddb-4a8d-ad5a-07c1074099d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:12.766044 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ec99c0d5-6ddb-4a8d-ad5a-07c1074099d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:12.766044 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ec99c0d5-6ddb-4a8d-ad5a-07c1074099d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:12.766724 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ec99c0d5-6ddb-4a8d-ad5a-07c1074099d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:12.767187 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ec99c0d5-6ddb-4a8d-ad5a-07c1074099d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:12.767752 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ec99c0d5-6ddb-4a8d-ad5a-07c1074099d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:12.799904 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ec99c0d5-6ddb-4a8d-ad5a-07c1074099d1 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048836 Oct 04 09:00:12.800575 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 412/870] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:00:12 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:12.962435 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f89c456f-ddb5-4530-83a8-168cabc181ef tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:12.963574 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f89c456f-ddb5-4530-83a8-168cabc181ef tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:12.973988 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f89c456f-ddb5-4530-83a8-168cabc181ef tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:12.974796 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f89c456f-ddb5-4530-83a8-168cabc181ef tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:12.975430 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f89c456f-ddb5-4530-83a8-168cabc181ef tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:12.976313 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f89c456f-ddb5-4530-83a8-168cabc181ef tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:12.976620 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f89c456f-ddb5-4530-83a8-168cabc181ef tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:12.977037 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f89c456f-ddb5-4530-83a8-168cabc181ef tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:13.119721 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f89c456f-ddb5-4530-83a8-168cabc181ef tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:13.131479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f89c456f-ddb5-4530-83a8-168cabc181ef tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1263 microversion: 2.1 time: 0.176315 Oct 04 09:00:13.132331 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 459/871] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:12 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:13.813466 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6b9ca8c0-023d-47c0-a142-d59b116280fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:13.815974 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6b9ca8c0-023d-47c0-a142-d59b116280fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:13.824193 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6b9ca8c0-023d-47c0-a142-d59b116280fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:13.824682 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6b9ca8c0-023d-47c0-a142-d59b116280fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:13.825112 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6b9ca8c0-023d-47c0-a142-d59b116280fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:13.825856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6b9ca8c0-023d-47c0-a142-d59b116280fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:13.826335 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6b9ca8c0-023d-47c0-a142-d59b116280fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:13.826752 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6b9ca8c0-023d-47c0-a142-d59b116280fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:13.858369 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6b9ca8c0-023d-47c0-a142-d59b116280fe tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049165 Oct 04 09:00:13.858930 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 413/872] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:00:13 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 09:00:13.943104 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-cd1bda4d-991d-48c0-88da-a75849097da6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:13.943643 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cd1bda4d-991d-48c0-88da-a75849097da6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:13.950349 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd1bda4d-991d-48c0-88da-a75849097da6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:13.950834 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd1bda4d-991d-48c0-88da-a75849097da6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:13.951265 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd1bda4d-991d-48c0-88da-a75849097da6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:13.951983 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd1bda4d-991d-48c0-88da-a75849097da6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:13.952432 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd1bda4d-991d-48c0-88da-a75849097da6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:13.952856 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd1bda4d-991d-48c0-88da-a75849097da6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:13.980382 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cd1bda4d-991d-48c0-88da-a75849097da6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Going to try to terminate instance {{(pid=142438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:00:14.067611 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-cd1bda4d-991d-48c0-88da-a75849097da6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 204 len: 0 microversion: 2.1 time: 0.127974 Oct 04 09:00:14.068329 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 460/873] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:00:13 2022] DELETE /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:00:14.077023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ea50ba16-39f5-4ce8-b6c0-b3390c9c260a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:14.077762 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ea50ba16-39f5-4ce8-b6c0-b3390c9c260a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:14.084235 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ea50ba16-39f5-4ce8-b6c0-b3390c9c260a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:14.084719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ea50ba16-39f5-4ce8-b6c0-b3390c9c260a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:14.085156 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ea50ba16-39f5-4ce8-b6c0-b3390c9c260a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:14.085844 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ea50ba16-39f5-4ce8-b6c0-b3390c9c260a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:14.086371 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ea50ba16-39f5-4ce8-b6c0-b3390c9c260a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:14.086717 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ea50ba16-39f5-4ce8-b6c0-b3390c9c260a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:14.155348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a0acd383-8c2a-4421-b177-5d726943fb2c tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:14.156105 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a0acd383-8c2a-4421-b177-5d726943fb2c tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:14.162429 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a0acd383-8c2a-4421-b177-5d726943fb2c tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:14.163397 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a0acd383-8c2a-4421-b177-5d726943fb2c tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:14.163397 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a0acd383-8c2a-4421-b177-5d726943fb2c tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:14.164274 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a0acd383-8c2a-4421-b177-5d726943fb2c tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:14.164728 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a0acd383-8c2a-4421-b177-5d726943fb2c tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:14.165188 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a0acd383-8c2a-4421-b177-5d726943fb2c tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:14.240086 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ea50ba16-39f5-4ce8-b6c0-b3390c9c260a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:14.249120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ea50ba16-39f5-4ce8-b6c0-b3390c9c260a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1691 microversion: 2.1 time: 0.176044 Oct 04 09:00:14.249795 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 414/874] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:14 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:14.312893 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-a0acd383-8c2a-4421-b177-5d726943fb2c tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:14.324542 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a0acd383-8c2a-4421-b177-5d726943fb2c tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1263 microversion: 2.1 time: 0.173156 Oct 04 09:00:14.325312 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 461/875] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:14 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:15.276875 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2c86396f-4b8e-424d-b806-b61623dbfe25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:15.277859 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2c86396f-4b8e-424d-b806-b61623dbfe25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:15.289092 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2c86396f-4b8e-424d-b806-b61623dbfe25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:15.289905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2c86396f-4b8e-424d-b806-b61623dbfe25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:15.290336 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2c86396f-4b8e-424d-b806-b61623dbfe25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:15.291019 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2c86396f-4b8e-424d-b806-b61623dbfe25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:15.291474 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2c86396f-4b8e-424d-b806-b61623dbfe25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:15.291932 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2c86396f-4b8e-424d-b806-b61623dbfe25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:15.352156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-26c67b09-2692-43d3-bb8b-c927bd87997b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:15.352863 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-26c67b09-2692-43d3-bb8b-c927bd87997b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:15.359782 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-26c67b09-2692-43d3-bb8b-c927bd87997b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:15.360305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-26c67b09-2692-43d3-bb8b-c927bd87997b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:15.360735 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-26c67b09-2692-43d3-bb8b-c927bd87997b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:15.361430 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-26c67b09-2692-43d3-bb8b-c927bd87997b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:15.361881 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-26c67b09-2692-43d3-bb8b-c927bd87997b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:15.362303 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-26c67b09-2692-43d3-bb8b-c927bd87997b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:15.465058 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2c86396f-4b8e-424d-b806-b61623dbfe25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:15.473354 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2c86396f-4b8e-424d-b806-b61623dbfe25 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1691 microversion: 2.1 time: 0.203057 Oct 04 09:00:15.473939 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 415/876] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:15 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1691 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:15.512518 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-26c67b09-2692-43d3-bb8b-c927bd87997b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:15.520657 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-26c67b09-2692-43d3-bb8b-c927bd87997b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1263 microversion: 2.1 time: 0.172491 Oct 04 09:00:15.521237 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 462/877] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:15 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:16.501839 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-47ea9ad6-3327-4465-a08c-6d7d65255cda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:16.502819 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-47ea9ad6-3327-4465-a08c-6d7d65255cda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:16.513836 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-47ea9ad6-3327-4465-a08c-6d7d65255cda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:16.514630 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-47ea9ad6-3327-4465-a08c-6d7d65255cda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:16.515348 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-47ea9ad6-3327-4465-a08c-6d7d65255cda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:16.516534 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-47ea9ad6-3327-4465-a08c-6d7d65255cda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:16.517282 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-47ea9ad6-3327-4465-a08c-6d7d65255cda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:16.517980 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-47ea9ad6-3327-4465-a08c-6d7d65255cda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:16.543662 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-19be567a-48a5-416c-8f4e-726252010ff0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:16.544289 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-19be567a-48a5-416c-8f4e-726252010ff0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:16.551128 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-19be567a-48a5-416c-8f4e-726252010ff0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:16.551612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-19be567a-48a5-416c-8f4e-726252010ff0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:16.552083 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-19be567a-48a5-416c-8f4e-726252010ff0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:16.552778 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-19be567a-48a5-416c-8f4e-726252010ff0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:16.553232 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-19be567a-48a5-416c-8f4e-726252010ff0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:16.553657 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-19be567a-48a5-416c-8f4e-726252010ff0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:16.715191 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-47ea9ad6-3327-4465-a08c-6d7d65255cda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:16.723183 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-47ea9ad6-3327-4465-a08c-6d7d65255cda tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1691 microversion: 2.1 time: 0.227988 Oct 04 09:00:16.723772 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 416/878] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:16 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1691 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:16.724188 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-19be567a-48a5-416c-8f4e-726252010ff0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:16.732062 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-19be567a-48a5-416c-8f4e-726252010ff0 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1263 microversion: 2.1 time: 0.192292 Oct 04 09:00:16.732705 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 463/879] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:16 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1263 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:17.747419 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a9a0dd6b-fab3-481a-83b1-1578bee80363 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:17.748073 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a9a0dd6b-fab3-481a-83b1-1578bee80363 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:17.751359 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:17.752202 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=6 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:17.761545 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1b607e4f-ec24-4bdf-85d8-fc82de4a59db tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:17.761545 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1b607e4f-ec24-4bdf-85d8-fc82de4a59db tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:17.762727 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a9a0dd6b-fab3-481a-83b1-1578bee80363 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:17.762727 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a9a0dd6b-fab3-481a-83b1-1578bee80363 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:17.762727 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a9a0dd6b-fab3-481a-83b1-1578bee80363 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:17.762727 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a9a0dd6b-fab3-481a-83b1-1578bee80363 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:17.763076 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:17.763203 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a9a0dd6b-fab3-481a-83b1-1578bee80363 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:17.763203 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a9a0dd6b-fab3-481a-83b1-1578bee80363 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:17.763355 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1b607e4f-ec24-4bdf-85d8-fc82de4a59db tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:17.763611 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1b607e4f-ec24-4bdf-85d8-fc82de4a59db tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:17.764003 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1b607e4f-ec24-4bdf-85d8-fc82de4a59db tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:17.764720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1b607e4f-ec24-4bdf-85d8-fc82de4a59db tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:17.765253 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1b607e4f-ec24-4bdf-85d8-fc82de4a59db tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:17.765710 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1b607e4f-ec24-4bdf-85d8-fc82de4a59db tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:17.955509 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a9a0dd6b-fab3-481a-83b1-1578bee80363 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:17.960219 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1b607e4f-ec24-4bdf-85d8-fc82de4a59db tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:17.964210 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a9a0dd6b-fab3-481a-83b1-1578bee80363 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1691 microversion: 2.1 time: 0.220570 Oct 04 09:00:17.964804 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 417/880] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:17 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1691 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:17.980074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1b607e4f-ec24-4bdf-85d8-fc82de4a59db tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1263 microversion: 2.1 time: 0.217510 Oct 04 09:00:17.980074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 464/881] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:17 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1263 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:18.987090 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-aa04c2db-0e68-4c83-afce-39f5e9be1849 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:18.988455 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-aa04c2db-0e68-4c83-afce-39f5e9be1849 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:18.990954 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f609b0ba-24b6-4306-bb34-124435f4e3fe tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:18.991753 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f609b0ba-24b6-4306-bb34-124435f4e3fe tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:18.995330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-aa04c2db-0e68-4c83-afce-39f5e9be1849 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:18.996056 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-aa04c2db-0e68-4c83-afce-39f5e9be1849 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:18.996499 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-aa04c2db-0e68-4c83-afce-39f5e9be1849 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:18.997202 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-aa04c2db-0e68-4c83-afce-39f5e9be1849 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:18.997644 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-aa04c2db-0e68-4c83-afce-39f5e9be1849 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:18.998254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-aa04c2db-0e68-4c83-afce-39f5e9be1849 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:18.998914 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f609b0ba-24b6-4306-bb34-124435f4e3fe tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:18.999435 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f609b0ba-24b6-4306-bb34-124435f4e3fe tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:18.999945 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f609b0ba-24b6-4306-bb34-124435f4e3fe tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:19.000709 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f609b0ba-24b6-4306-bb34-124435f4e3fe tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:19.001223 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f609b0ba-24b6-4306-bb34-124435f4e3fe tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:19.001990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f609b0ba-24b6-4306-bb34-124435f4e3fe tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:19.071290 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-aa04c2db-0e68-4c83-afce-39f5e9be1849 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:19.077709 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:19.080264 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-aa04c2db-0e68-4c83-afce-39f5e9be1849 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 200 len: 1623 microversion: 2.1 time: 0.097414 Oct 04 09:00:19.080853 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 465/882] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:18 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 1623 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:19.101753 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-58bc927b-84b2-4a54-a095-2bd34d481f48 req-85c5bd2b-0ca4-40ee-a207-9c3cb757842d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d4e170-63f9-4fa3-858f-9be84ff18613", "name": "network-vif-deleted", "tag": "f3fc8c79-adbb-46ec-b7f3-b0d7539f5735"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:19.112080 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-58bc927b-84b2-4a54-a095-2bd34d481f48 req-85c5bd2b-0ca4-40ee-a207-9c3cb757842d service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:19.112838 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-58bc927b-84b2-4a54-a095-2bd34d481f48 req-85c5bd2b-0ca4-40ee-a207-9c3cb757842d service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:19.113440 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-58bc927b-84b2-4a54-a095-2bd34d481f48 req-85c5bd2b-0ca4-40ee-a207-9c3cb757842d service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:19.135132 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-58bc927b-84b2-4a54-a095-2bd34d481f48 req-85c5bd2b-0ca4-40ee-a207-9c3cb757842d service nova] Creating event network-vif-deleted:f3fc8c79-adbb-46ec-b7f3-b0d7539f5735 for instance e8d4e170-63f9-4fa3-858f-9be84ff18613 on hv-cinder-84456 Oct 04 09:00:19.139012 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-58bc927b-84b2-4a54-a095-2bd34d481f48 req-85c5bd2b-0ca4-40ee-a207-9c3cb757842d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045477 Oct 04 09:00:19.139628 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 466/883] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:19.199554 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f609b0ba-24b6-4306-bb34-124435f4e3fe tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:19.208705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f609b0ba-24b6-4306-bb34-124435f4e3fe tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1263 microversion: 2.1 time: 0.221430 Oct 04 09:00:19.210087 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 418/884] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:18 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1263 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:19.966000 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-7f0347db-c348-43fe-ba5e-a5a690180229 req-d9888ad9-fad8-416e-8760-9dd56d678353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61244f16-1483-4d31-a6de-0d4689a62479", "name": "network-vif-plugged", "status": "completed", "tag": "ad67ba62-fb95-40fd-bf8f-f28d45c2e22f"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:19.977234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-7f0347db-c348-43fe-ba5e-a5a690180229 req-d9888ad9-fad8-416e-8760-9dd56d678353 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:19.977786 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-7f0347db-c348-43fe-ba5e-a5a690180229 req-d9888ad9-fad8-416e-8760-9dd56d678353 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:19.978284 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-7f0347db-c348-43fe-ba5e-a5a690180229 req-d9888ad9-fad8-416e-8760-9dd56d678353 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:19.990103 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-7f0347db-c348-43fe-ba5e-a5a690180229 req-d9888ad9-fad8-416e-8760-9dd56d678353 service nova] Creating event network-vif-plugged:ad67ba62-fb95-40fd-bf8f-f28d45c2e22f for instance 61244f16-1483-4d31-a6de-0d4689a62479 on hv-cinder-84456 Oct 04 09:00:19.995345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-7f0347db-c348-43fe-ba5e-a5a690180229 req-d9888ad9-fad8-416e-8760-9dd56d678353 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033375 Oct 04 09:00:19.995970 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 467/885] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 09:00:20.113395 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c11ffe11-e871-4ede-9529-6990353855b6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:20.114145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c11ffe11-e871-4ede-9529-6990353855b6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: e8d4e170-63f9-4fa3-858f-9be84ff18613] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:20.122079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c11ffe11-e871-4ede-9529-6990353855b6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:20.122854 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c11ffe11-e871-4ede-9529-6990353855b6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:20.123310 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c11ffe11-e871-4ede-9529-6990353855b6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:20.124025 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c11ffe11-e871-4ede-9529-6990353855b6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:20.124497 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c11ffe11-e871-4ede-9529-6990353855b6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:20.124925 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c11ffe11-e871-4ede-9529-6990353855b6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:20.139009 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-c11ffe11-e871-4ede-9529-6990353855b6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] HTTP exception thrown: Instance e8d4e170-63f9-4fa3-858f-9be84ff18613 could not be found. Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c11ffe11-e871-4ede-9529-6990353855b6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Request method failure captured: Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 HTTP/1.1 Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_QgccWxYajYjnYlxW2wOpmxEq7P2SD3jaoRxscKzYQChsbHwOl030EUF30Pu5JsIqD55efxkHlt99A0cxoM9Jnpj9RKPjJ0Gow11cqdorfXuhDlAAQMZmcLNdYXLD6ljS836T8ojAOd2thWO0Qa3jMLRufhlcsdQKqvbl-NKe8LtTQ Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: ba66b134261b494b964e9f050449a0fe Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1657257525 Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:00:20.140715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:00:20.142181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ba66b134261b494b964e9f050449a0fe", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ba66b134261b494b964e9f050449a0fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ba66b134261b494b964e9f050449a0fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ba66b134261b494b964e9f050449a0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:00:20.142181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1657257525 Oct 04 09:00:20.142181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: ba66b134261b494b964e9f050449a0fe Oct 04 09:00:20.142181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1657257525 Oct 04 09:00:20.142181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-ServerRescueNegativeTestJSON-1657257525-project Oct 04 09:00:20.142181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:00:20.142181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:00:20.142181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 1d22ff09fb6743c2880af0d7778fb984 Oct 04 09:00:20.142181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1657257525-project Oct 04 09:00:20.142181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:00:20.142181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance e8d4e170-63f9-4fa3-858f-9be84ff18613 could not be found. Oct 04 09:00:20.142181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': 'e8d4e170-63f9-4fa3-858f-9be84ff18613'} Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d4e170-63f9-4fa3-858f-9be84ff18613 could not be found. Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:00:20.146344 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d4e170-63f9-4fa3-858f-9be84ff18613 could not be found. Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d4e170-63f9-4fa3-858f-9be84ff18613 could not be found. Oct 04 09:00:20.147934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:00:20.149271 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c11ffe11-e871-4ede-9529-6990353855b6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Returning 404 to user: Instance e8d4e170-63f9-4fa3-858f-9be84ff18613 could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:00:20.149271 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c11ffe11-e871-4ede-9529-6990353855b6 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613" status: 404 len: 111 microversion: 2.1 time: 0.033385 Oct 04 09:00:20.149271 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 419/886] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:20 2022] GET /compute/v2.1/servers/e8d4e170-63f9-4fa3-858f-9be84ff18613 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:00:20.153520 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e5a9f16e-a937-4519-b845-566cd95384bf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '.version_select at 0x7ff92e1421f0>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:20.175053 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e5a9f16e-a937-4519-b845-566cd95384bf tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1796103133" status: 202 len: 0 microversion: 2.1 time: 0.026220 Oct 04 09:00:20.175648 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 468/887] 10.222.0.44 () {58 vars in 1221 bytes} [Tue Oct 4 09:00:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1796103133 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:00:20.236508 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a66c0812-c8e9-4b1c-bea3-75156eaa6348 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:20.237123 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a66c0812-c8e9-4b1c-bea3-75156eaa6348 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:20.243854 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a66c0812-c8e9-4b1c-bea3-75156eaa6348 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:20.244561 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a66c0812-c8e9-4b1c-bea3-75156eaa6348 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:20.245144 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a66c0812-c8e9-4b1c-bea3-75156eaa6348 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:20.246069 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a66c0812-c8e9-4b1c-bea3-75156eaa6348 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:20.246712 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a66c0812-c8e9-4b1c-bea3-75156eaa6348 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:20.250463 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a66c0812-c8e9-4b1c-bea3-75156eaa6348 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:20.422935 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a66c0812-c8e9-4b1c-bea3-75156eaa6348 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:20.431736 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a66c0812-c8e9-4b1c-bea3-75156eaa6348 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1263 microversion: 2.1 time: 0.199056 Oct 04 09:00:20.432357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 420/888] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:20 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1263 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:21.459633 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-981e21e4-06ac-4356-a67a-2c01453f1bda tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:21.460896 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-981e21e4-06ac-4356-a67a-2c01453f1bda tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:21.474686 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-981e21e4-06ac-4356-a67a-2c01453f1bda tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:21.475831 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-981e21e4-06ac-4356-a67a-2c01453f1bda tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:21.476594 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-981e21e4-06ac-4356-a67a-2c01453f1bda tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:21.477588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-981e21e4-06ac-4356-a67a-2c01453f1bda tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:21.478052 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-981e21e4-06ac-4356-a67a-2c01453f1bda tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:21.478473 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-981e21e4-06ac-4356-a67a-2c01453f1bda tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:21.615620 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-981e21e4-06ac-4356-a67a-2c01453f1bda tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:21.623858 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-981e21e4-06ac-4356-a67a-2c01453f1bda tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1263 microversion: 2.1 time: 0.171489 Oct 04 09:00:21.624468 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 469/889] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:21 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:22.651139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e437769b-46fa-44ad-8912-bdc57942074d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:22.652219 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e437769b-46fa-44ad-8912-bdc57942074d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:22.663211 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e437769b-46fa-44ad-8912-bdc57942074d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:22.664082 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e437769b-46fa-44ad-8912-bdc57942074d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:22.664817 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e437769b-46fa-44ad-8912-bdc57942074d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:22.666007 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e437769b-46fa-44ad-8912-bdc57942074d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:22.666464 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e437769b-46fa-44ad-8912-bdc57942074d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:22.666892 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e437769b-46fa-44ad-8912-bdc57942074d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:22.806168 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e437769b-46fa-44ad-8912-bdc57942074d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:22.814262 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e437769b-46fa-44ad-8912-bdc57942074d tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1450 microversion: 2.1 time: 0.169744 Oct 04 09:00:22.814873 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 421/890] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:22 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:22.836769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8647b2f1-7417-4581-b398-7bcd6818ac7e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:22.837385 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8647b2f1-7417-4581-b398-7bcd6818ac7e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:22.844410 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8647b2f1-7417-4581-b398-7bcd6818ac7e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:22.844887 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8647b2f1-7417-4581-b398-7bcd6818ac7e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:22.845318 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8647b2f1-7417-4581-b398-7bcd6818ac7e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:22.846001 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8647b2f1-7417-4581-b398-7bcd6818ac7e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:22.846446 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8647b2f1-7417-4581-b398-7bcd6818ac7e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:22.846898 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8647b2f1-7417-4581-b398-7bcd6818ac7e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:22.981647 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8647b2f1-7417-4581-b398-7bcd6818ac7e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:22.989474 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8647b2f1-7417-4581-b398-7bcd6818ac7e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1450 microversion: 2.1 time: 0.156722 Oct 04 09:00:22.990106 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 470/891] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:22 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:23.236267 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8bef09ec-bd4f-4dff-9bc3-3b9c31a9fe49 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:23.236878 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8bef09ec-bd4f-4dff-9bc3-3b9c31a9fe49 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:23.243322 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8bef09ec-bd4f-4dff-9bc3-3b9c31a9fe49 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:23.244062 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8bef09ec-bd4f-4dff-9bc3-3b9c31a9fe49 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:23.244495 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8bef09ec-bd4f-4dff-9bc3-3b9c31a9fe49 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:23.245300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8bef09ec-bd4f-4dff-9bc3-3b9c31a9fe49 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:23.245812 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8bef09ec-bd4f-4dff-9bc3-3b9c31a9fe49 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:23.246298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8bef09ec-bd4f-4dff-9bc3-3b9c31a9fe49 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:23.271397 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8bef09ec-bd4f-4dff-9bc3-3b9c31a9fe49 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Going to try to terminate instance {{(pid=142439) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:00:23.298522 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=100 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:23.354253 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8bef09ec-bd4f-4dff-9bc3-3b9c31a9fe49 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "DELETE /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 204 len: 0 microversion: 2.1 time: 0.121521 Oct 04 09:00:23.355465 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 422/892] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:00:23 2022] DELETE /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:00:23.364422 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-159473ea-9e4b-4623-a0fc-342ea04619b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:23.365286 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-159473ea-9e4b-4623-a0fc-342ea04619b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:23.371862 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-159473ea-9e4b-4623-a0fc-342ea04619b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:23.372375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-159473ea-9e4b-4623-a0fc-342ea04619b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:23.372843 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-159473ea-9e4b-4623-a0fc-342ea04619b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:23.373496 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-159473ea-9e4b-4623-a0fc-342ea04619b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:23.373944 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-159473ea-9e4b-4623-a0fc-342ea04619b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:23.374352 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-159473ea-9e4b-4623-a0fc-342ea04619b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:23.596752 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-159473ea-9e4b-4623-a0fc-342ea04619b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:23.605167 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-159473ea-9e4b-4623-a0fc-342ea04619b7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1507 microversion: 2.1 time: 0.244921 Oct 04 09:00:23.605952 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 471/893] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:23 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:24.628866 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6307b4ee-a7f4-46aa-9e12-db75c63cdeb5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:24.629712 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6307b4ee-a7f4-46aa-9e12-db75c63cdeb5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:24.636219 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6307b4ee-a7f4-46aa-9e12-db75c63cdeb5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:24.637012 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6307b4ee-a7f4-46aa-9e12-db75c63cdeb5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:24.637795 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6307b4ee-a7f4-46aa-9e12-db75c63cdeb5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:24.638581 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6307b4ee-a7f4-46aa-9e12-db75c63cdeb5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:24.639135 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6307b4ee-a7f4-46aa-9e12-db75c63cdeb5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:24.639657 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6307b4ee-a7f4-46aa-9e12-db75c63cdeb5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:24.758299 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6307b4ee-a7f4-46aa-9e12-db75c63cdeb5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:24.763522 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-a0ea9727-b295-43c1-8396-59058d3b1ce3 req-26305b94-1d2b-4abb-a0db-ac04dc4c6694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e21016-5037-4bd1-91c6-97ab1b413e06", "name": "network-vif-deleted", "tag": "df43f084-777f-4af6-b2a6-2d0d23572e5e"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:24.779791 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6307b4ee-a7f4-46aa-9e12-db75c63cdeb5 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 200 len: 1465 microversion: 2.1 time: 0.155016 Oct 04 09:00:24.783059 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 423/894] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:24 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 1465 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:24.787762 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-a0ea9727-b295-43c1-8396-59058d3b1ce3 req-26305b94-1d2b-4abb-a0db-ac04dc4c6694 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:24.788575 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-a0ea9727-b295-43c1-8396-59058d3b1ce3 req-26305b94-1d2b-4abb-a0db-ac04dc4c6694 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:24.789231 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-a0ea9727-b295-43c1-8396-59058d3b1ce3 req-26305b94-1d2b-4abb-a0db-ac04dc4c6694 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:24.803015 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-a0ea9727-b295-43c1-8396-59058d3b1ce3 req-26305b94-1d2b-4abb-a0db-ac04dc4c6694 service nova] Creating event network-vif-deleted:df43f084-777f-4af6-b2a6-2d0d23572e5e for instance 69e21016-5037-4bd1-91c6-97ab1b413e06 on hv-cinder-84456 Oct 04 09:00:24.810256 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-a0ea9727-b295-43c1-8396-59058d3b1ce3 req-26305b94-1d2b-4abb-a0db-ac04dc4c6694 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050360 Oct 04 09:00:24.812027 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 472/895] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:24.814936 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-102fe92c-7446-43d1-b5ba-b54987b03d24 req-57f8d381-8b9c-44a8-8860-61d11e34ceda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61244f16-1483-4d31-a6de-0d4689a62479", "tag": "ad67ba62-fb95-40fd-bf8f-f28d45c2e22f"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:24.826611 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-102fe92c-7446-43d1-b5ba-b54987b03d24 req-57f8d381-8b9c-44a8-8860-61d11e34ceda service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:24.827087 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-102fe92c-7446-43d1-b5ba-b54987b03d24 req-57f8d381-8b9c-44a8-8860-61d11e34ceda service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:24.827734 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-102fe92c-7446-43d1-b5ba-b54987b03d24 req-57f8d381-8b9c-44a8-8860-61d11e34ceda service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:24.839253 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-102fe92c-7446-43d1-b5ba-b54987b03d24 req-57f8d381-8b9c-44a8-8860-61d11e34ceda service nova] Creating event network-changed:ad67ba62-fb95-40fd-bf8f-f28d45c2e22f for instance 61244f16-1483-4d31-a6de-0d4689a62479 on hv-cinder-84456 Oct 04 09:00:24.844645 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-102fe92c-7446-43d1-b5ba-b54987b03d24 req-57f8d381-8b9c-44a8-8860-61d11e34ceda service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039657 Oct 04 09:00:24.845503 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 424/896] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 09:00:25.813097 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b379a630-8813-4b83-8142-e47ec73a251d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:25.814435 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b379a630-8813-4b83-8142-e47ec73a251d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: 69e21016-5037-4bd1-91c6-97ab1b413e06] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:25.821053 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b379a630-8813-4b83-8142-e47ec73a251d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:25.821540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b379a630-8813-4b83-8142-e47ec73a251d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:25.822162 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b379a630-8813-4b83-8142-e47ec73a251d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:25.822923 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b379a630-8813-4b83-8142-e47ec73a251d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:25.823397 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b379a630-8813-4b83-8142-e47ec73a251d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:25.823848 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b379a630-8813-4b83-8142-e47ec73a251d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:25.837574 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-b379a630-8813-4b83-8142-e47ec73a251d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] HTTP exception thrown: Instance 69e21016-5037-4bd1-91c6-97ab1b413e06 could not be found. Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b379a630-8813-4b83-8142-e47ec73a251d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Request method failure captured: Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 HTTP/1.1 Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_QgccWxYajYjnYlxW2wOpmxEq7P2SD3jaoRxscKzYQChsbHwOl030EUF30Pu5JsIqD55efxkHlt99A0cxoM9Jnpj9RKPjJ0Gow11cqdorfXuhDlAAQMZmcLNdYXLD6ljS836T8ojAOd2thWO0Qa3jMLRufhlcsdQKqvbl-NKe8LtTQ Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: ba66b134261b494b964e9f050449a0fe Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1657257525 Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:00:25.839209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:00:25.840802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ba66b134261b494b964e9f050449a0fe", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ba66b134261b494b964e9f050449a0fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ba66b134261b494b964e9f050449a0fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ba66b134261b494b964e9f050449a0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:00:25.840802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1657257525 Oct 04 09:00:25.840802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: ba66b134261b494b964e9f050449a0fe Oct 04 09:00:25.840802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1657257525 Oct 04 09:00:25.840802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-ServerRescueNegativeTestJSON-1657257525-project Oct 04 09:00:25.840802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:00:25.840802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:00:25.840802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 1d22ff09fb6743c2880af0d7778fb984 Oct 04 09:00:25.840802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1657257525-project Oct 04 09:00:25.840802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:00:25.840802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance 69e21016-5037-4bd1-91c6-97ab1b413e06 could not be found. Oct 04 09:00:25.840802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': '69e21016-5037-4bd1-91c6-97ab1b413e06'} Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e21016-5037-4bd1-91c6-97ab1b413e06 could not be found. Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:00:25.841591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e21016-5037-4bd1-91c6-97ab1b413e06 could not be found. Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e21016-5037-4bd1-91c6-97ab1b413e06 could not be found. Oct 04 09:00:25.842964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:00:25.844288 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b379a630-8813-4b83-8142-e47ec73a251d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Returning 404 to user: Instance 69e21016-5037-4bd1-91c6-97ab1b413e06 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:00:25.844288 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b379a630-8813-4b83-8142-e47ec73a251d tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06" status: 404 len: 111 microversion: 2.1 time: 0.032493 Oct 04 09:00:25.844288 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 473/897] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:25 2022] GET /compute/v2.1/servers/69e21016-5037-4bd1-91c6-97ab1b413e06 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:00:25.850809 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d8268cb5-0fbb-4406-a8a9-ec9b6c03e04a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:25.851376 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d8268cb5-0fbb-4406-a8a9-ec9b6c03e04a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:25.858602 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d8268cb5-0fbb-4406-a8a9-ec9b6c03e04a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:25.859067 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d8268cb5-0fbb-4406-a8a9-ec9b6c03e04a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:25.859516 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d8268cb5-0fbb-4406-a8a9-ec9b6c03e04a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:25.860292 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d8268cb5-0fbb-4406-a8a9-ec9b6c03e04a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:25.860747 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d8268cb5-0fbb-4406-a8a9-ec9b6c03e04a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:25.861197 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d8268cb5-0fbb-4406-a8a9-ec9b6c03e04a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:25.887310 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d8268cb5-0fbb-4406-a8a9-ec9b6c03e04a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Going to try to terminate instance {{(pid=142439) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:00:25.976923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d8268cb5-0fbb-4406-a8a9-ec9b6c03e04a tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 204 len: 0 microversion: 2.1 time: 0.130566 Oct 04 09:00:25.977593 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 425/898] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:00:25 2022] DELETE /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:00:25.986065 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-3d5594c2-e476-454a-96fa-156a1e53d589 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:25.986614 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-3d5594c2-e476-454a-96fa-156a1e53d589 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:25.993246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3d5594c2-e476-454a-96fa-156a1e53d589 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:25.993754 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3d5594c2-e476-454a-96fa-156a1e53d589 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:25.994187 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3d5594c2-e476-454a-96fa-156a1e53d589 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:25.994865 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3d5594c2-e476-454a-96fa-156a1e53d589 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:25.995310 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3d5594c2-e476-454a-96fa-156a1e53d589 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:25.995725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3d5594c2-e476-454a-96fa-156a1e53d589 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:26.379110 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3d5594c2-e476-454a-96fa-156a1e53d589 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:26.388895 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-3d5594c2-e476-454a-96fa-156a1e53d589 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1522 microversion: 2.1 time: 0.406785 Oct 04 09:00:26.389458 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 474/899] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:25 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:27.412726 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-506644c2-74b5-47ab-a6c1-bc144092a003 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:27.413427 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-506644c2-74b5-47ab-a6c1-bc144092a003 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:27.420004 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-506644c2-74b5-47ab-a6c1-bc144092a003 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:27.420491 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-506644c2-74b5-47ab-a6c1-bc144092a003 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:27.420930 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-506644c2-74b5-47ab-a6c1-bc144092a003 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:27.421624 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-506644c2-74b5-47ab-a6c1-bc144092a003 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:27.422107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-506644c2-74b5-47ab-a6c1-bc144092a003 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:27.422521 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-506644c2-74b5-47ab-a6c1-bc144092a003 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:27.647940 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-506644c2-74b5-47ab-a6c1-bc144092a003 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ff09fb6743c2880af0d7778fb984', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba66b134261b494b964e9f050449a0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:27.656142 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-506644c2-74b5-47ab-a6c1-bc144092a003 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 200 len: 1480 microversion: 2.1 time: 0.247748 Oct 04 09:00:27.671734 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 426/900] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:27 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 1480 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:27.672346 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-5c40b744-3da7-4f0a-979f-1a07c0e5d80b req-28b465dd-393b-4b03-9395-66b0d8992f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28f0369-796d-4b75-b047-ccf9a6998560", "name": "network-vif-deleted", "tag": "5dfb7890-2a06-487d-91f3-6ff8a9259582"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:27.680577 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-5c40b744-3da7-4f0a-979f-1a07c0e5d80b req-28b465dd-393b-4b03-9395-66b0d8992f88 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:27.681179 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-5c40b744-3da7-4f0a-979f-1a07c0e5d80b req-28b465dd-393b-4b03-9395-66b0d8992f88 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:27.681630 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-5c40b744-3da7-4f0a-979f-1a07c0e5d80b req-28b465dd-393b-4b03-9395-66b0d8992f88 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:27.693683 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-5c40b744-3da7-4f0a-979f-1a07c0e5d80b req-28b465dd-393b-4b03-9395-66b0d8992f88 service nova] Creating event network-vif-deleted:5dfb7890-2a06-487d-91f3-6ff8a9259582 for instance d28f0369-796d-4b75-b047-ccf9a6998560 on hv-cinder-84456 Oct 04 09:00:27.698727 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-5c40b744-3da7-4f0a-979f-1a07c0e5d80b req-28b465dd-393b-4b03-9395-66b0d8992f88 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032664 Oct 04 09:00:27.699639 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 475/901] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:28.683854 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-7aed9884-d4bd-4c70-a712-74455fffb8f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:28.684825 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-7aed9884-d4bd-4c70-a712-74455fffb8f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] [instance: d28f0369-796d-4b75-b047-ccf9a6998560] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:28.695751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7aed9884-d4bd-4c70-a712-74455fffb8f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:28.696634 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7aed9884-d4bd-4c70-a712-74455fffb8f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:28.697334 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7aed9884-d4bd-4c70-a712-74455fffb8f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:28.698069 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7aed9884-d4bd-4c70-a712-74455fffb8f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:28.698576 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7aed9884-d4bd-4c70-a712-74455fffb8f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:28.699000 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7aed9884-d4bd-4c70-a712-74455fffb8f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:28.712726 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-7aed9884-d4bd-4c70-a712-74455fffb8f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] HTTP exception thrown: Instance d28f0369-796d-4b75-b047-ccf9a6998560 could not be found. Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-7aed9884-d4bd-4c70-a712-74455fffb8f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Request method failure captured: Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 HTTP/1.1 Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_QgccWxYajYjnYlxW2wOpmxEq7P2SD3jaoRxscKzYQChsbHwOl030EUF30Pu5JsIqD55efxkHlt99A0cxoM9Jnpj9RKPjJ0Gow11cqdorfXuhDlAAQMZmcLNdYXLD6ljS836T8ojAOd2thWO0Qa3jMLRufhlcsdQKqvbl-NKe8LtTQ Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: ba66b134261b494b964e9f050449a0fe Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1657257525 Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:00:28.714366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:00:28.716104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ba66b134261b494b964e9f050449a0fe", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ba66b134261b494b964e9f050449a0fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ba66b134261b494b964e9f050449a0fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ba66b134261b494b964e9f050449a0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:00:28.716104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1657257525 Oct 04 09:00:28.716104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: ba66b134261b494b964e9f050449a0fe Oct 04 09:00:28.716104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1657257525 Oct 04 09:00:28.716104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-ServerRescueNegativeTestJSON-1657257525-project Oct 04 09:00:28.716104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:00:28.716104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:00:28.716104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 1d22ff09fb6743c2880af0d7778fb984 Oct 04 09:00:28.716104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1657257525-project Oct 04 09:00:28.716104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:00:28.716104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance d28f0369-796d-4b75-b047-ccf9a6998560 could not be found. Oct 04 09:00:28.716104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': 'd28f0369-796d-4b75-b047-ccf9a6998560'} Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28f0369-796d-4b75-b047-ccf9a6998560 could not be found. Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:00:28.716912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28f0369-796d-4b75-b047-ccf9a6998560 could not be found. Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28f0369-796d-4b75-b047-ccf9a6998560 could not be found. Oct 04 09:00:28.718129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:00:28.719262 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-7aed9884-d4bd-4c70-a712-74455fffb8f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] Returning 404 to user: Instance d28f0369-796d-4b75-b047-ccf9a6998560 could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:00:28.719262 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-7aed9884-d4bd-4c70-a712-74455fffb8f7 tempest-ServerRescueNegativeTestJSON-1657257525 tempest-ServerRescueNegativeTestJSON-1657257525-project] 10.222.0.44 "GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560" status: 404 len: 111 microversion: 2.1 time: 0.038673 Oct 04 09:00:28.719262 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 427/902] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:28 2022] GET /compute/v2.1/servers/d28f0369-796d-4b75-b047-ccf9a6998560 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:00:29.586517 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ffad9ed3-42e9-44e7-9bd1-8c8eaed48810 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:29.589011 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ffad9ed3-42e9-44e7-9bd1-8c8eaed48810 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:29.596866 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffad9ed3-42e9-44e7-9bd1-8c8eaed48810 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:29.597555 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffad9ed3-42e9-44e7-9bd1-8c8eaed48810 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:29.597960 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffad9ed3-42e9-44e7-9bd1-8c8eaed48810 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:29.599256 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffad9ed3-42e9-44e7-9bd1-8c8eaed48810 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:29.599947 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffad9ed3-42e9-44e7-9bd1-8c8eaed48810 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:29.600511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffad9ed3-42e9-44e7-9bd1-8c8eaed48810 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:29.677683 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ffad9ed3-42e9-44e7-9bd1-8c8eaed48810 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "POST /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/action" status: 202 len: 0 microversion: 2.1 time: 0.095948 Oct 04 09:00:29.678860 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 476/903] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Oct 4 09:00:29 2022] POST /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:00:29.687869 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-81ec9b69-07e0-4613-9f40-728c329bc686 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:29.688487 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-81ec9b69-07e0-4613-9f40-728c329bc686 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:29.695343 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-81ec9b69-07e0-4613-9f40-728c329bc686 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:29.696157 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-81ec9b69-07e0-4613-9f40-728c329bc686 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:29.696609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-81ec9b69-07e0-4613-9f40-728c329bc686 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:29.697372 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-81ec9b69-07e0-4613-9f40-728c329bc686 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:29.698003 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-81ec9b69-07e0-4613-9f40-728c329bc686 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:29.698423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-81ec9b69-07e0-4613-9f40-728c329bc686 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:29.927796 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-81ec9b69-07e0-4613-9f40-728c329bc686 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:29.948890 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-81ec9b69-07e0-4613-9f40-728c329bc686 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1753 microversion: 2.1 time: 0.264853 Oct 04 09:00:29.950833 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 428/904] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:29 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1753 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:30.973680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-cd460c81-ce56-4b5d-992d-c0a186d32279 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:30.974457 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cd460c81-ce56-4b5d-992d-c0a186d32279 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:30.981603 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd460c81-ce56-4b5d-992d-c0a186d32279 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:30.982069 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd460c81-ce56-4b5d-992d-c0a186d32279 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:30.982705 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd460c81-ce56-4b5d-992d-c0a186d32279 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:30.983373 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd460c81-ce56-4b5d-992d-c0a186d32279 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:30.983939 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd460c81-ce56-4b5d-992d-c0a186d32279 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:30.984730 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cd460c81-ce56-4b5d-992d-c0a186d32279 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:31.131072 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cd460c81-ce56-4b5d-992d-c0a186d32279 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:31.139904 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-cd460c81-ce56-4b5d-992d-c0a186d32279 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1758 microversion: 2.1 time: 0.170534 Oct 04 09:00:31.140553 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 477/905] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:30 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:32.163824 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-71cdde82-1080-4957-882e-3fd26a00a2b1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:32.164406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-71cdde82-1080-4957-882e-3fd26a00a2b1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:32.166933 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:32.172380 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-71cdde82-1080-4957-882e-3fd26a00a2b1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:32.172881 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-71cdde82-1080-4957-882e-3fd26a00a2b1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:32.173325 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-71cdde82-1080-4957-882e-3fd26a00a2b1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:32.174008 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-71cdde82-1080-4957-882e-3fd26a00a2b1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:32.174515 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-71cdde82-1080-4957-882e-3fd26a00a2b1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:32.174988 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-71cdde82-1080-4957-882e-3fd26a00a2b1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:32.366845 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-71cdde82-1080-4957-882e-3fd26a00a2b1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:32.376747 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-71cdde82-1080-4957-882e-3fd26a00a2b1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1758 microversion: 2.1 time: 0.216866 Oct 04 09:00:32.377573 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 429/906] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:32 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1758 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:33.402717 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-649dd2d4-a6d9-45c0-a070-6a3031f1c234 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:33.403491 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-649dd2d4-a6d9-45c0-a070-6a3031f1c234 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:33.406077 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:33.412410 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-649dd2d4-a6d9-45c0-a070-6a3031f1c234 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:33.412896 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-649dd2d4-a6d9-45c0-a070-6a3031f1c234 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:33.413400 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-649dd2d4-a6d9-45c0-a070-6a3031f1c234 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:33.414111 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-649dd2d4-a6d9-45c0-a070-6a3031f1c234 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:33.414563 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-649dd2d4-a6d9-45c0-a070-6a3031f1c234 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:33.414985 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-649dd2d4-a6d9-45c0-a070-6a3031f1c234 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:33.559185 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-649dd2d4-a6d9-45c0-a070-6a3031f1c234 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:33.567447 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-649dd2d4-a6d9-45c0-a070-6a3031f1c234 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1758 microversion: 2.1 time: 0.168720 Oct 04 09:00:33.568179 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 478/907] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:33 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:33.880965 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c97a3569-7c8e-4b0a-8121-a899bda1576a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:33.883269 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c97a3569-7c8e-4b0a-8121-a899bda1576a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:33.889841 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c97a3569-7c8e-4b0a-8121-a899bda1576a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:33.890326 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c97a3569-7c8e-4b0a-8121-a899bda1576a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:33.890920 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c97a3569-7c8e-4b0a-8121-a899bda1576a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:33.891780 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c97a3569-7c8e-4b0a-8121-a899bda1576a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:33.892339 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c97a3569-7c8e-4b0a-8121-a899bda1576a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:33.892818 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c97a3569-7c8e-4b0a-8121-a899bda1576a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:33.923796 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c97a3569-7c8e-4b0a-8121-a899bda1576a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046986 Oct 04 09:00:33.924397 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 430/908] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:00:33 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 09:00:33.989658 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-265b3c82-933f-401c-ae87-593885725581 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:33.990216 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-265b3c82-933f-401c-ae87-593885725581 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:33.996551 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-265b3c82-933f-401c-ae87-593885725581 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:33.997108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-265b3c82-933f-401c-ae87-593885725581 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:33.997543 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-265b3c82-933f-401c-ae87-593885725581 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:33.998227 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-265b3c82-933f-401c-ae87-593885725581 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:33.998676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-265b3c82-933f-401c-ae87-593885725581 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:33.999096 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-265b3c82-933f-401c-ae87-593885725581 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:34.024584 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-265b3c82-933f-401c-ae87-593885725581 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Going to try to terminate instance {{(pid=142438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:00:34.103812 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-265b3c82-933f-401c-ae87-593885725581 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "DELETE /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 204 len: 0 microversion: 2.1 time: 0.118938 Oct 04 09:00:34.104439 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 479/909] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:00:33 2022] DELETE /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:00:34.113220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c2c1770c-568f-4c9a-8d8a-6cc6be7a9064 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:34.113988 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c2c1770c-568f-4c9a-8d8a-6cc6be7a9064 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:34.121355 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c2c1770c-568f-4c9a-8d8a-6cc6be7a9064 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:34.121847 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c2c1770c-568f-4c9a-8d8a-6cc6be7a9064 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:34.122424 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c2c1770c-568f-4c9a-8d8a-6cc6be7a9064 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:34.123040 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c2c1770c-568f-4c9a-8d8a-6cc6be7a9064 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:34.123564 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c2c1770c-568f-4c9a-8d8a-6cc6be7a9064 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:34.124206 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c2c1770c-568f-4c9a-8d8a-6cc6be7a9064 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:34.267744 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c2c1770c-568f-4c9a-8d8a-6cc6be7a9064 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:34.277310 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c2c1770c-568f-4c9a-8d8a-6cc6be7a9064 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1673 microversion: 2.1 time: 0.168342 Oct 04 09:00:34.277903 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 431/910] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:34 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:34.596447 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-231e2393-f7b5-471e-8ba6-83a953ea2e2b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:34.597648 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-231e2393-f7b5-471e-8ba6-83a953ea2e2b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:34.607344 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-231e2393-f7b5-471e-8ba6-83a953ea2e2b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:34.607833 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-231e2393-f7b5-471e-8ba6-83a953ea2e2b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:34.608304 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-231e2393-f7b5-471e-8ba6-83a953ea2e2b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:34.609001 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-231e2393-f7b5-471e-8ba6-83a953ea2e2b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:34.609455 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-231e2393-f7b5-471e-8ba6-83a953ea2e2b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:34.609881 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-231e2393-f7b5-471e-8ba6-83a953ea2e2b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:34.762905 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-231e2393-f7b5-471e-8ba6-83a953ea2e2b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:34.771341 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-231e2393-f7b5-471e-8ba6-83a953ea2e2b tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1758 microversion: 2.1 time: 0.182094 Oct 04 09:00:34.771879 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 480/911] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:34 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:35.300654 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fa704e52-3688-404c-a678-6140df901333 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:35.301272 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-fa704e52-3688-404c-a678-6140df901333 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:35.308142 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fa704e52-3688-404c-a678-6140df901333 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:35.308659 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fa704e52-3688-404c-a678-6140df901333 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:35.309093 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fa704e52-3688-404c-a678-6140df901333 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:35.309785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fa704e52-3688-404c-a678-6140df901333 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:35.310238 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fa704e52-3688-404c-a678-6140df901333 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:35.310657 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fa704e52-3688-404c-a678-6140df901333 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:35.441290 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-fa704e52-3688-404c-a678-6140df901333 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:35.450836 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fa704e52-3688-404c-a678-6140df901333 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1673 microversion: 2.1 time: 0.154018 Oct 04 09:00:35.451590 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 432/912] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:35 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:35.795202 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-de33d498-d0c3-41aa-b13c-d238b57b97ff tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:35.795769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-de33d498-d0c3-41aa-b13c-d238b57b97ff tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:35.802828 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de33d498-d0c3-41aa-b13c-d238b57b97ff tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:35.803354 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de33d498-d0c3-41aa-b13c-d238b57b97ff tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:35.803783 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de33d498-d0c3-41aa-b13c-d238b57b97ff tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:35.804526 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de33d498-d0c3-41aa-b13c-d238b57b97ff tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:35.804979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de33d498-d0c3-41aa-b13c-d238b57b97ff tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:35.805404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de33d498-d0c3-41aa-b13c-d238b57b97ff tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:35.951913 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-de33d498-d0c3-41aa-b13c-d238b57b97ff tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:35.960301 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-de33d498-d0c3-41aa-b13c-d238b57b97ff tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1758 microversion: 2.1 time: 0.169343 Oct 04 09:00:35.961041 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 481/913] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:35 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:36.466436 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-9ee6f305-b212-4017-80c7-d006ec0c5a2f req-6467ad0a-5b63-43d5-8e72-8c316657c795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86725d76-c18e-4df2-94ff-93d73b5bc65f", "name": "network-vif-deleted", "tag": "da852373-b7f7-4d27-921e-8fabd651eaa5"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:36.475425 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-49d0ff53-77f3-4b82-8df7-bc332387e937 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:36.477040 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-49d0ff53-77f3-4b82-8df7-bc332387e937 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:36.477899 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-9ee6f305-b212-4017-80c7-d006ec0c5a2f req-6467ad0a-5b63-43d5-8e72-8c316657c795 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:36.478394 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-9ee6f305-b212-4017-80c7-d006ec0c5a2f req-6467ad0a-5b63-43d5-8e72-8c316657c795 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:36.478821 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-9ee6f305-b212-4017-80c7-d006ec0c5a2f req-6467ad0a-5b63-43d5-8e72-8c316657c795 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:36.484698 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-49d0ff53-77f3-4b82-8df7-bc332387e937 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:36.485255 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-49d0ff53-77f3-4b82-8df7-bc332387e937 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:36.485725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-49d0ff53-77f3-4b82-8df7-bc332387e937 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:36.486474 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-49d0ff53-77f3-4b82-8df7-bc332387e937 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:36.486856 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-49d0ff53-77f3-4b82-8df7-bc332387e937 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:36.492243 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-9ee6f305-b212-4017-80c7-d006ec0c5a2f req-6467ad0a-5b63-43d5-8e72-8c316657c795 service nova] Creating event network-vif-deleted:da852373-b7f7-4d27-921e-8fabd651eaa5 for instance 86725d76-c18e-4df2-94ff-93d73b5bc65f on hv-cinder-84456 Oct 04 09:00:36.496644 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-49d0ff53-77f3-4b82-8df7-bc332387e937 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:36.497811 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-9ee6f305-b212-4017-80c7-d006ec0c5a2f req-6467ad0a-5b63-43d5-8e72-8c316657c795 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035499 Oct 04 09:00:36.501594 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 433/914] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:36.578534 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-49d0ff53-77f3-4b82-8df7-bc332387e937 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:36.587526 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-49d0ff53-77f3-4b82-8df7-bc332387e937 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 200 len: 1605 microversion: 2.1 time: 0.116443 Oct 04 09:00:36.588853 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 482/915] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:36 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 1605 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:36.987419 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-7da9e9a3-841d-4458-896e-60535784c949 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:36.988595 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-7da9e9a3-841d-4458-896e-60535784c949 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:36.998241 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7da9e9a3-841d-4458-896e-60535784c949 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:36.998965 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7da9e9a3-841d-4458-896e-60535784c949 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:36.999623 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7da9e9a3-841d-4458-896e-60535784c949 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:37.000712 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7da9e9a3-841d-4458-896e-60535784c949 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:37.001399 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7da9e9a3-841d-4458-896e-60535784c949 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:37.002041 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7da9e9a3-841d-4458-896e-60535784c949 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:37.159389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7da9e9a3-841d-4458-896e-60535784c949 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:37.168237 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-7da9e9a3-841d-4458-896e-60535784c949 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1758 microversion: 2.1 time: 0.188061 Oct 04 09:00:37.183913 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 434/916] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:36 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:37.610929 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-56ffd125-28a1-4efa-b182-422f78c995ef tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:37.611549 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-56ffd125-28a1-4efa-b182-422f78c995ef tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:37.618746 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-56ffd125-28a1-4efa-b182-422f78c995ef tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:37.619295 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-56ffd125-28a1-4efa-b182-422f78c995ef tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:37.619724 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-56ffd125-28a1-4efa-b182-422f78c995ef tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:37.620548 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-56ffd125-28a1-4efa-b182-422f78c995ef tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:37.621040 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-56ffd125-28a1-4efa-b182-422f78c995ef tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:37.621503 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-56ffd125-28a1-4efa-b182-422f78c995ef tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:37.635411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-56ffd125-28a1-4efa-b182-422f78c995ef tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] HTTP exception thrown: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-56ffd125-28a1-4efa-b182-422f78c995ef tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Request method failure captured: Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f HTTP/1.1 Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_SX1mQUowrwr4CF41WchcB8Z4uueLDMnrte3fNgF_nm7WpEQIgaMQ6118JNMrNXXRFMp6bsSZgs_L-Y5M4CCjYW3UYcqrAytuJwfE-hnL8T8c36V_TH5jHUGZsGSck6lF1D2hGa-AcM8WvyOOlftc_6o3nEmyIsu3axlf5TTGbeX7U Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: b7ad37ea522247c6b28ea40e1bc43669 Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:00:37.637127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:00:37.638478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b7ad37ea522247c6b28ea40e1bc43669", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:00:37.638478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:00:37.638478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: b7ad37ea522247c6b28ea40e1bc43669 Oct 04 09:00:37.638478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:00:37.638478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-AttachVolumeTestJSON-610189389-project Oct 04 09:00:37.638478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:00:37.638478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:00:37.638478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: e71984f02fcd4deba5e1430ec85b8705 Oct 04 09:00:37.638478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-AttachVolumeTestJSON-610189389-project Oct 04 09:00:37.638478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:00:37.638478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. Oct 04 09:00:37.638478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': '86725d76-c18e-4df2-94ff-93d73b5bc65f'} Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:00:37.639224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. Oct 04 09:00:37.640587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:00:37.641937 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-56ffd125-28a1-4efa-b182-422f78c995ef tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Returning 404 to user: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:00:37.641937 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-56ffd125-28a1-4efa-b182-422f78c995ef tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 404 len: 111 microversion: 2.1 time: 0.031495 Oct 04 09:00:37.641937 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 483/917] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:37 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:00:37.647720 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c265010c-778b-4308-b9b0-0b4960232b8e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '.version_select at 0x7ff92e250d30>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:37.670343 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c265010c-778b-4308-b9b0-0b4960232b8e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-203502749" status: 202 len: 0 microversion: 2.1 time: 0.026499 Oct 04 09:00:37.670896 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 435/918] 10.222.0.44 () {58 vars in 1218 bytes} [Tue Oct 4 09:00:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-203502749 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:00:38.192475 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-3b01920b-52bd-4597-bd15-415c0613085d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:38.193090 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-3b01920b-52bd-4597-bd15-415c0613085d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:38.200593 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3b01920b-52bd-4597-bd15-415c0613085d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:38.201221 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3b01920b-52bd-4597-bd15-415c0613085d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:38.201653 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3b01920b-52bd-4597-bd15-415c0613085d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:38.202375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3b01920b-52bd-4597-bd15-415c0613085d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:38.202818 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3b01920b-52bd-4597-bd15-415c0613085d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:38.203228 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3b01920b-52bd-4597-bd15-415c0613085d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:38.350339 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c132b8f9-bf42-42af-8aad-70f8d0a5c18b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Action: 'create', calling method: .version_select at 0x7ff92e248e50>, body: {"keypair": {"name": "tempest-keypair-1188627538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsiGkePn3wQim7O5aQiaKWhBJhJbqEd8SsPHri9otnDXR8eDk+jKN68MZG5a77rltKLvwEFXD21QDbh0owwHpzRzABRxAtbAazTR0j0/5p9XZBRRD27psDit4Yidt9Ceg=="}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:38.368442 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-c132b8f9-bf42-42af-8aad-70f8d0a5c18b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Getting quotas for project b7ad37ea522247c6b28ea40e1bc43669. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:00:38.373298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3b01920b-52bd-4597-bd15-415c0613085d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:38.373487 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-c132b8f9-bf42-42af-8aad-70f8d0a5c18b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Getting quotas for user e71984f02fcd4deba5e1430ec85b8705 and project b7ad37ea522247c6b28ea40e1bc43669. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:00:38.376821 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:38.382703 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-3b01920b-52bd-4597-bd15-415c0613085d tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1758 microversion: 2.1 time: 0.194191 Oct 04 09:00:38.383273 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 484/919] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:38 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:38.396442 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c132b8f9-bf42-42af-8aad-70f8d0a5c18b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050173 Oct 04 09:00:38.399910 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 436/920] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Oct 4 09:00:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:39.406720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2dade8ed-4ea5-4ad0-8288-3baed74eade6 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:39.407335 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2dade8ed-4ea5-4ad0-8288-3baed74eade6 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:39.415323 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2dade8ed-4ea5-4ad0-8288-3baed74eade6 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:39.415839 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2dade8ed-4ea5-4ad0-8288-3baed74eade6 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:39.416509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2dade8ed-4ea5-4ad0-8288-3baed74eade6 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:39.417445 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2dade8ed-4ea5-4ad0-8288-3baed74eade6 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:39.417895 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2dade8ed-4ea5-4ad0-8288-3baed74eade6 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:39.418306 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2dade8ed-4ea5-4ad0-8288-3baed74eade6 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:39.649874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2dade8ed-4ea5-4ad0-8288-3baed74eade6 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:39.658461 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2dade8ed-4ea5-4ad0-8288-3baed74eade6 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1758 microversion: 2.1 time: 0.255658 Oct 04 09:00:39.659038 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 485/921] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:39 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1758 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:40.010786 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-394080193", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e5acea3-b968-4513-b5c4-a35e676fc1e7"}], "security_groups": [{"name": "tempest-securitygroup--2022330703"}], "key_name": "tempest-keypair-1188627538", "user_data": "}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:40.125641 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.network.neutron [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] validate_networks() for [('8e5acea3-b968-4513-b5c4-a35e676fc1e7', None, None, None, None, None)] {{(pid=142439) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:00:40.512927 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Flavor limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:00:40.513404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Image limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:00:40.513906 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Flavor pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:00:40.514313 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Image pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:00:40.514728 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:00:40.523736 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:40.524251 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:40.524689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:40.525412 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:40.525866 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:40.526292 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:40.543034 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Getting quotas for project b7ad37ea522247c6b28ea40e1bc43669. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:00:40.546948 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Getting quotas for user e71984f02fcd4deba5e1430ec85b8705 and project b7ad37ea522247c6b28ea40e1bc43669. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:00:40.557621 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Going to run 1 instances... {{(pid=142439) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:00:40.559915 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:00:40.618845 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f5d59495-1dad-413e-bfca-43b8ec990ca4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.612429 Oct 04 09:00:40.625166 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 437/922] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 09:00:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 09:00:40.630760 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8f7efb5d-96fa-4a64-9363-40581ae1af00 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:40.631371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8f7efb5d-96fa-4a64-9363-40581ae1af00 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:40.682179 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f22566d3-7252-4353-8384-9bb4912ed4e8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:40.682841 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f22566d3-7252-4353-8384-9bb4912ed4e8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:40.685483 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8f7efb5d-96fa-4a64-9363-40581ae1af00 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:40.691275 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f22566d3-7252-4353-8384-9bb4912ed4e8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:40.691763 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f22566d3-7252-4353-8384-9bb4912ed4e8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:40.692246 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f22566d3-7252-4353-8384-9bb4912ed4e8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:40.692936 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f22566d3-7252-4353-8384-9bb4912ed4e8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:40.693382 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f22566d3-7252-4353-8384-9bb4912ed4e8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:40.693486 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8f7efb5d-96fa-4a64-9363-40581ae1af00 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 200 len: 1237 microversion: 2.1 time: 0.066503 Oct 04 09:00:40.693800 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f22566d3-7252-4353-8384-9bb4912ed4e8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:40.694141 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 486/923] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:40 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:40.849729 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f22566d3-7252-4353-8384-9bb4912ed4e8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:40.860310 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f22566d3-7252-4353-8384-9bb4912ed4e8 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1758 microversion: 2.1 time: 0.182197 Oct 04 09:00:40.860884 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 438/924] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:40 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:41.719269 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e60aa367-511c-436a-b19e-906f6e8f4acc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:41.719955 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e60aa367-511c-436a-b19e-906f6e8f4acc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:41.728484 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e60aa367-511c-436a-b19e-906f6e8f4acc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:41.728964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e60aa367-511c-436a-b19e-906f6e8f4acc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:41.729393 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e60aa367-511c-436a-b19e-906f6e8f4acc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:41.730076 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e60aa367-511c-436a-b19e-906f6e8f4acc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:41.730552 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e60aa367-511c-436a-b19e-906f6e8f4acc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:41.730964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e60aa367-511c-436a-b19e-906f6e8f4acc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:41.795301 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e60aa367-511c-436a-b19e-906f6e8f4acc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:41.803566 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e60aa367-511c-436a-b19e-906f6e8f4acc tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 200 len: 1289 microversion: 2.1 time: 0.089436 Oct 04 09:00:41.804220 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 487/925] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:41 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:41.884446 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-560f4fe7-50f2-4190-b9db-4774a15197b5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:41.885091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-560f4fe7-50f2-4190-b9db-4774a15197b5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:41.891695 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-560f4fe7-50f2-4190-b9db-4774a15197b5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:41.892233 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-560f4fe7-50f2-4190-b9db-4774a15197b5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:41.892668 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-560f4fe7-50f2-4190-b9db-4774a15197b5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:41.893356 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-560f4fe7-50f2-4190-b9db-4774a15197b5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:41.893808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-560f4fe7-50f2-4190-b9db-4774a15197b5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:41.894224 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-560f4fe7-50f2-4190-b9db-4774a15197b5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:42.045923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-560f4fe7-50f2-4190-b9db-4774a15197b5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:42.056196 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-560f4fe7-50f2-4190-b9db-4774a15197b5 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1758 microversion: 2.1 time: 0.175402 Oct 04 09:00:42.068936 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 439/926] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:41 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:42.827183 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-143d4074-c3e7-4934-b6d4-ad329189b072 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:42.828435 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-143d4074-c3e7-4934-b6d4-ad329189b072 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:42.835056 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-143d4074-c3e7-4934-b6d4-ad329189b072 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:42.835547 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-143d4074-c3e7-4934-b6d4-ad329189b072 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:42.836017 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-143d4074-c3e7-4934-b6d4-ad329189b072 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:42.836718 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-143d4074-c3e7-4934-b6d4-ad329189b072 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:42.837172 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-143d4074-c3e7-4934-b6d4-ad329189b072 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:42.837601 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-143d4074-c3e7-4934-b6d4-ad329189b072 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:43.012435 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-143d4074-c3e7-4934-b6d4-ad329189b072 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:43.021379 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-143d4074-c3e7-4934-b6d4-ad329189b072 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 200 len: 1363 microversion: 2.1 time: 0.198063 Oct 04 09:00:43.021965 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 488/927] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:42 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:43.082237 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-414f43e8-da8a-46a1-9333-c59053305cf9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:43.083420 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-414f43e8-da8a-46a1-9333-c59053305cf9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:43.091250 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-414f43e8-da8a-46a1-9333-c59053305cf9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:43.091919 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-414f43e8-da8a-46a1-9333-c59053305cf9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:43.092420 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-414f43e8-da8a-46a1-9333-c59053305cf9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:43.093296 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-414f43e8-da8a-46a1-9333-c59053305cf9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:43.093755 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-414f43e8-da8a-46a1-9333-c59053305cf9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:43.094194 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-414f43e8-da8a-46a1-9333-c59053305cf9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:43.238528 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-414f43e8-da8a-46a1-9333-c59053305cf9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:43.247382 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-414f43e8-da8a-46a1-9333-c59053305cf9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1758 microversion: 2.1 time: 0.170464 Oct 04 09:00:43.247974 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 440/928] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:43 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:43.679629 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-c3d514e3-4577-47f0-bab6-538ea4e26a3a req-0849c0b5-552e-48d9-99f0-a867cfe4d887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf524cd-6e38-49e5-8e86-36f2b089ab1b", "tag": "9d933822-6ec8-4793-8ee8-cc7fd4f83411"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:43.689865 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-c3d514e3-4577-47f0-bab6-538ea4e26a3a req-0849c0b5-552e-48d9-99f0-a867cfe4d887 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:43.690344 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-c3d514e3-4577-47f0-bab6-538ea4e26a3a req-0849c0b5-552e-48d9-99f0-a867cfe4d887 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:43.690769 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-c3d514e3-4577-47f0-bab6-538ea4e26a3a req-0849c0b5-552e-48d9-99f0-a867cfe4d887 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:43.702351 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-c3d514e3-4577-47f0-bab6-538ea4e26a3a req-0849c0b5-552e-48d9-99f0-a867cfe4d887 service nova] Creating event network-changed:9d933822-6ec8-4793-8ee8-cc7fd4f83411 for instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b on hv-cinder-84456 Oct 04 09:00:43.710571 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-c3d514e3-4577-47f0-bab6-538ea4e26a3a req-0849c0b5-552e-48d9-99f0-a867cfe4d887 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034303 Oct 04 09:00:43.711718 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 489/929] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:44.046664 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-dd72ee79-d81a-4e00-ad75-6fa63d584cb4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:44.047551 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-dd72ee79-d81a-4e00-ad75-6fa63d584cb4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:44.057083 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd72ee79-d81a-4e00-ad75-6fa63d584cb4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:44.057749 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd72ee79-d81a-4e00-ad75-6fa63d584cb4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:44.058347 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd72ee79-d81a-4e00-ad75-6fa63d584cb4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:44.059195 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd72ee79-d81a-4e00-ad75-6fa63d584cb4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:44.059646 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd72ee79-d81a-4e00-ad75-6fa63d584cb4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:44.060120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dd72ee79-d81a-4e00-ad75-6fa63d584cb4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:44.079100 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:44.198229 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dd72ee79-d81a-4e00-ad75-6fa63d584cb4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:44.209992 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-dd72ee79-d81a-4e00-ad75-6fa63d584cb4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 200 len: 1363 microversion: 2.1 time: 0.168694 Oct 04 09:00:44.210585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 441/930] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:44 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:44.272456 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-18ba272c-a40a-439d-84c0-888e216457aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:44.273368 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-18ba272c-a40a-439d-84c0-888e216457aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:44.280372 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-18ba272c-a40a-439d-84c0-888e216457aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:44.280951 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-18ba272c-a40a-439d-84c0-888e216457aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:44.281386 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-18ba272c-a40a-439d-84c0-888e216457aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:44.282107 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-18ba272c-a40a-439d-84c0-888e216457aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:44.282672 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-18ba272c-a40a-439d-84c0-888e216457aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:44.283188 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-18ba272c-a40a-439d-84c0-888e216457aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:44.427917 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-18ba272c-a40a-439d-84c0-888e216457aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:44.436937 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-18ba272c-a40a-439d-84c0-888e216457aa tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1758 microversion: 2.1 time: 0.169901 Oct 04 09:00:44.437601 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 490/931] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:44 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:45.234455 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0a80b2fd-788a-4b7d-859c-794d5006c7be tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:45.235077 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0a80b2fd-788a-4b7d-859c-794d5006c7be tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:45.241842 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a80b2fd-788a-4b7d-859c-794d5006c7be tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:45.242330 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a80b2fd-788a-4b7d-859c-794d5006c7be tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:45.243118 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a80b2fd-788a-4b7d-859c-794d5006c7be tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:45.243822 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a80b2fd-788a-4b7d-859c-794d5006c7be tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:45.244307 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a80b2fd-788a-4b7d-859c-794d5006c7be tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:45.244732 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a80b2fd-788a-4b7d-859c-794d5006c7be tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:45.378570 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0a80b2fd-788a-4b7d-859c-794d5006c7be tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:45.386614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0a80b2fd-788a-4b7d-859c-794d5006c7be tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 200 len: 1363 microversion: 2.1 time: 0.156566 Oct 04 09:00:45.387229 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 442/932] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:45 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:45.460553 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-11fc37dd-b72a-45ea-9ff2-bb87c49d98d3 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:45.461144 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-11fc37dd-b72a-45ea-9ff2-bb87c49d98d3 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:45.468091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fc37dd-b72a-45ea-9ff2-bb87c49d98d3 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:45.468550 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fc37dd-b72a-45ea-9ff2-bb87c49d98d3 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:45.468963 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fc37dd-b72a-45ea-9ff2-bb87c49d98d3 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:45.469950 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fc37dd-b72a-45ea-9ff2-bb87c49d98d3 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:45.470488 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fc37dd-b72a-45ea-9ff2-bb87c49d98d3 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:45.470915 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-11fc37dd-b72a-45ea-9ff2-bb87c49d98d3 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:45.662512 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-11fc37dd-b72a-45ea-9ff2-bb87c49d98d3 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:45.675252 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-11fc37dd-b72a-45ea-9ff2-bb87c49d98d3 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1758 microversion: 2.1 time: 0.218095 Oct 04 09:00:45.676040 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 491/933] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:45 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1758 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:46.410241 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-26ccd985-5f2d-4265-bf17-578ce49ef545 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:46.411020 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-26ccd985-5f2d-4265-bf17-578ce49ef545 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:46.417922 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-26ccd985-5f2d-4265-bf17-578ce49ef545 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:46.418520 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-26ccd985-5f2d-4265-bf17-578ce49ef545 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:46.419045 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-26ccd985-5f2d-4265-bf17-578ce49ef545 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:46.419812 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-26ccd985-5f2d-4265-bf17-578ce49ef545 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:46.420293 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-26ccd985-5f2d-4265-bf17-578ce49ef545 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:46.420840 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-26ccd985-5f2d-4265-bf17-578ce49ef545 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:46.553941 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-26ccd985-5f2d-4265-bf17-578ce49ef545 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:46.562112 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-26ccd985-5f2d-4265-bf17-578ce49ef545 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 200 len: 1363 microversion: 2.1 time: 0.156336 Oct 04 09:00:46.562694 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 443/934] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:46 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:46.702313 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e0fcdf62-6429-4bc1-9b07-f42dd7378ebd tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:46.703611 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e0fcdf62-6429-4bc1-9b07-f42dd7378ebd tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:46.710748 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e0fcdf62-6429-4bc1-9b07-f42dd7378ebd tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:46.711471 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e0fcdf62-6429-4bc1-9b07-f42dd7378ebd tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:46.712023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e0fcdf62-6429-4bc1-9b07-f42dd7378ebd tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:46.713224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e0fcdf62-6429-4bc1-9b07-f42dd7378ebd tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:46.713808 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e0fcdf62-6429-4bc1-9b07-f42dd7378ebd tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:46.714400 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e0fcdf62-6429-4bc1-9b07-f42dd7378ebd tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:47.036144 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e0fcdf62-6429-4bc1-9b07-f42dd7378ebd tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:47.044503 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e0fcdf62-6429-4bc1-9b07-f42dd7378ebd tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1758 microversion: 2.1 time: 0.346481 Oct 04 09:00:47.045080 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 492/935] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:46 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1758 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:47.585858 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-db5cf6ec-a950-4832-a16b-4be330cc6f6a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:47.586398 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-db5cf6ec-a950-4832-a16b-4be330cc6f6a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:47.593536 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-db5cf6ec-a950-4832-a16b-4be330cc6f6a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:47.594072 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-db5cf6ec-a950-4832-a16b-4be330cc6f6a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:47.594504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-db5cf6ec-a950-4832-a16b-4be330cc6f6a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:47.595199 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-db5cf6ec-a950-4832-a16b-4be330cc6f6a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:47.595644 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-db5cf6ec-a950-4832-a16b-4be330cc6f6a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:47.596097 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-db5cf6ec-a950-4832-a16b-4be330cc6f6a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:47.759299 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-db5cf6ec-a950-4832-a16b-4be330cc6f6a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:47.773015 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-db5cf6ec-a950-4832-a16b-4be330cc6f6a tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 200 len: 1363 microversion: 2.1 time: 0.191266 Oct 04 09:00:47.773772 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 444/936] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:47 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:48.067573 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6c6d22f1-ef08-43ff-a7bf-2e324b4dac74 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:48.068171 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6c6d22f1-ef08-43ff-a7bf-2e324b4dac74 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:48.074875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6c6d22f1-ef08-43ff-a7bf-2e324b4dac74 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:48.075381 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6c6d22f1-ef08-43ff-a7bf-2e324b4dac74 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:48.075804 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6c6d22f1-ef08-43ff-a7bf-2e324b4dac74 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:48.076616 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6c6d22f1-ef08-43ff-a7bf-2e324b4dac74 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:48.077063 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6c6d22f1-ef08-43ff-a7bf-2e324b4dac74 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:48.077477 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6c6d22f1-ef08-43ff-a7bf-2e324b4dac74 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:48.223470 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6c6d22f1-ef08-43ff-a7bf-2e324b4dac74 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:48.232332 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6c6d22f1-ef08-43ff-a7bf-2e324b4dac74 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1761 microversion: 2.1 time: 0.168633 Oct 04 09:00:48.233001 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 493/937] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:48 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1761 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:00:48.795965 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b9f41043-1226-48b5-b6f9-6ad0989e7ef4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:48.796567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b9f41043-1226-48b5-b6f9-6ad0989e7ef4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:48.803205 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9f41043-1226-48b5-b6f9-6ad0989e7ef4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:48.803686 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9f41043-1226-48b5-b6f9-6ad0989e7ef4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:48.804142 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9f41043-1226-48b5-b6f9-6ad0989e7ef4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:48.804828 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9f41043-1226-48b5-b6f9-6ad0989e7ef4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:48.805275 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9f41043-1226-48b5-b6f9-6ad0989e7ef4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:48.805688 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9f41043-1226-48b5-b6f9-6ad0989e7ef4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:48.941802 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b9f41043-1226-48b5-b6f9-6ad0989e7ef4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:48.950415 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b9f41043-1226-48b5-b6f9-6ad0989e7ef4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 200 len: 1363 microversion: 2.1 time: 0.158307 Oct 04 09:00:48.951431 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 445/938] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:48 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:49.245437 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-0c79293d-038f-4649-b275-b6261fa00b2c req-b48f6525-51ee-4a76-834c-1d89578819d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf524cd-6e38-49e5-8e86-36f2b089ab1b", "name": "network-vif-plugged", "status": "completed", "tag": "9d933822-6ec8-4793-8ee8-cc7fd4f83411"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:49.255348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-0c79293d-038f-4649-b275-b6261fa00b2c req-b48f6525-51ee-4a76-834c-1d89578819d9 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:49.255828 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-0c79293d-038f-4649-b275-b6261fa00b2c req-b48f6525-51ee-4a76-834c-1d89578819d9 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:49.256340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-0c79293d-038f-4649-b275-b6261fa00b2c req-b48f6525-51ee-4a76-834c-1d89578819d9 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:49.268294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-0c79293d-038f-4649-b275-b6261fa00b2c req-b48f6525-51ee-4a76-834c-1d89578819d9 service nova] Creating event network-vif-plugged:9d933822-6ec8-4793-8ee8-cc7fd4f83411 for instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b on hv-cinder-84456 Oct 04 09:00:49.273359 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-0c79293d-038f-4649-b275-b6261fa00b2c req-b48f6525-51ee-4a76-834c-1d89578819d9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033576 Oct 04 09:00:49.274326 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 494/939] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:49.974437 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e24a2c98-54f2-43d9-9cfb-bac8f5df89f4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:49.975238 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e24a2c98-54f2-43d9-9cfb-bac8f5df89f4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:49.981989 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e24a2c98-54f2-43d9-9cfb-bac8f5df89f4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:49.982581 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e24a2c98-54f2-43d9-9cfb-bac8f5df89f4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:49.983015 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e24a2c98-54f2-43d9-9cfb-bac8f5df89f4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:49.983703 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e24a2c98-54f2-43d9-9cfb-bac8f5df89f4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:49.984176 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e24a2c98-54f2-43d9-9cfb-bac8f5df89f4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:49.984598 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e24a2c98-54f2-43d9-9cfb-bac8f5df89f4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:50.113345 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e24a2c98-54f2-43d9-9cfb-bac8f5df89f4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:50.121778 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e24a2c98-54f2-43d9-9cfb-bac8f5df89f4 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 200 len: 1363 microversion: 2.1 time: 0.151241 Oct 04 09:00:50.122521 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 446/940] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:49 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:00:50.248490 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-41b03f49-28a2-4f4f-aef5-a55188befec4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:50.249026 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-41b03f49-28a2-4f4f-aef5-a55188befec4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:50.255920 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41b03f49-28a2-4f4f-aef5-a55188befec4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:50.256424 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41b03f49-28a2-4f4f-aef5-a55188befec4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:50.256846 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41b03f49-28a2-4f4f-aef5-a55188befec4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:50.257533 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41b03f49-28a2-4f4f-aef5-a55188befec4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:50.257976 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41b03f49-28a2-4f4f-aef5-a55188befec4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:50.258381 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41b03f49-28a2-4f4f-aef5-a55188befec4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:50.282578 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-41b03f49-28a2-4f4f-aef5-a55188befec4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9/ips" status: 200 len: 151 microversion: 2.20 time: 0.038465 Oct 04 09:00:50.283103 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 495/941] 10.222.0.44 () {60 vars in 1289 bytes} [Tue Oct 4 09:00:50 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 09:00:51.145983 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-21bab172-0a30-4090-885f-f610e83ac85e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:51.146598 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-21bab172-0a30-4090-885f-f610e83ac85e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:51.148461 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:51.149278 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=10 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:51.155821 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-21bab172-0a30-4090-885f-f610e83ac85e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:51.156328 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-21bab172-0a30-4090-885f-f610e83ac85e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:51.156880 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-21bab172-0a30-4090-885f-f610e83ac85e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:51.157452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-21bab172-0a30-4090-885f-f610e83ac85e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:51.157902 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-21bab172-0a30-4090-885f-f610e83ac85e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:51.158317 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-21bab172-0a30-4090-885f-f610e83ac85e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:51.291370 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-21bab172-0a30-4090-885f-f610e83ac85e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:51.299321 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-21bab172-0a30-4090-885f-f610e83ac85e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 200 len: 1549 microversion: 2.1 time: 0.157345 Oct 04 09:00:51.300030 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 447/942] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:51 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:51.321877 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-bb59fe8c-9f42-4ce5-92f4-488169b69869 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:51.322489 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-bb59fe8c-9f42-4ce5-92f4-488169b69869 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:51.324373 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:51.330654 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bb59fe8c-9f42-4ce5-92f4-488169b69869 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:51.331353 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bb59fe8c-9f42-4ce5-92f4-488169b69869 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:51.331826 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bb59fe8c-9f42-4ce5-92f4-488169b69869 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:51.332611 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bb59fe8c-9f42-4ce5-92f4-488169b69869 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:51.333067 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bb59fe8c-9f42-4ce5-92f4-488169b69869 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:51.333513 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bb59fe8c-9f42-4ce5-92f4-488169b69869 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:51.417876 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-bb59fe8c-9f42-4ce5-92f4-488169b69869 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099940 Oct 04 09:00:51.418562 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 496/943] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Oct 4 09:00:51 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:52.195085 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-792f7a83-a54c-4b5d-8d28-31e8ce4b2213 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:52.195675 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-792f7a83-a54c-4b5d-8d28-31e8ce4b2213 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:52.202543 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-792f7a83-a54c-4b5d-8d28-31e8ce4b2213 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:52.203069 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-792f7a83-a54c-4b5d-8d28-31e8ce4b2213 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:52.203508 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-792f7a83-a54c-4b5d-8d28-31e8ce4b2213 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:52.204221 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-792f7a83-a54c-4b5d-8d28-31e8ce4b2213 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:52.204908 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-792f7a83-a54c-4b5d-8d28-31e8ce4b2213 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:52.205337 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-792f7a83-a54c-4b5d-8d28-31e8ce4b2213 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:52.241054 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-792f7a83-a54c-4b5d-8d28-31e8ce4b2213 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lazy-loading 'flavor' on Instance uuid 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:00:52.383211 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-8404c2ea-fb3d-4074-a4d6-e5035eb7401c req-f0d51233-77bc-401f-9aff-9c5e5ae91537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf524cd-6e38-49e5-8e86-36f2b089ab1b", "tag": "9d933822-6ec8-4793-8ee8-cc7fd4f83411"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:52.393084 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-8404c2ea-fb3d-4074-a4d6-e5035eb7401c req-f0d51233-77bc-401f-9aff-9c5e5ae91537 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:52.393556 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-8404c2ea-fb3d-4074-a4d6-e5035eb7401c req-f0d51233-77bc-401f-9aff-9c5e5ae91537 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:52.394015 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-8404c2ea-fb3d-4074-a4d6-e5035eb7401c req-f0d51233-77bc-401f-9aff-9c5e5ae91537 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:52.406534 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-8404c2ea-fb3d-4074-a4d6-e5035eb7401c req-f0d51233-77bc-401f-9aff-9c5e5ae91537 service nova] Creating event network-changed:9d933822-6ec8-4793-8ee8-cc7fd4f83411 for instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b on hv-cinder-84456 Oct 04 09:00:52.411980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-8404c2ea-fb3d-4074-a4d6-e5035eb7401c req-f0d51233-77bc-401f-9aff-9c5e5ae91537 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033082 Oct 04 09:00:52.412585 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 497/944] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:52.443713 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-792f7a83-a54c-4b5d-8d28-31e8ce4b2213 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "POST /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9/action" status: 202 len: 0 microversion: 2.20 time: 0.250993 Oct 04 09:00:52.444610 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 448/945] 10.222.0.44 () {62 vars in 1319 bytes} [Tue Oct 4 09:00:52 2022] POST /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:00:52.454375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4640bbb4-3a2f-41cf-bfa3-3a27f298638f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:52.455078 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4640bbb4-3a2f-41cf-bfa3-3a27f298638f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:52.461294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4640bbb4-3a2f-41cf-bfa3-3a27f298638f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:52.461782 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4640bbb4-3a2f-41cf-bfa3-3a27f298638f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:52.462219 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4640bbb4-3a2f-41cf-bfa3-3a27f298638f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:52.462910 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4640bbb4-3a2f-41cf-bfa3-3a27f298638f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:52.463369 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4640bbb4-3a2f-41cf-bfa3-3a27f298638f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:52.463785 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4640bbb4-3a2f-41cf-bfa3-3a27f298638f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:52.607462 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4640bbb4-3a2f-41cf-bfa3-3a27f298638f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:52.616150 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4640bbb4-3a2f-41cf-bfa3-3a27f298638f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:52.618278 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4640bbb4-3a2f-41cf-bfa3-3a27f298638f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:52.619367 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4640bbb4-3a2f-41cf-bfa3-3a27f298638f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.169669 Oct 04 09:00:52.620333 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 498/946] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:00:52 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:00:53.646662 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-dbb81f9a-84eb-40ab-8c54-ece37435acba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:53.647341 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-dbb81f9a-84eb-40ab-8c54-ece37435acba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:53.654108 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dbb81f9a-84eb-40ab-8c54-ece37435acba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:53.654822 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dbb81f9a-84eb-40ab-8c54-ece37435acba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:53.655262 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dbb81f9a-84eb-40ab-8c54-ece37435acba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:53.655989 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dbb81f9a-84eb-40ab-8c54-ece37435acba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:53.656441 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dbb81f9a-84eb-40ab-8c54-ece37435acba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:53.656865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dbb81f9a-84eb-40ab-8c54-ece37435acba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:53.789491 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dbb81f9a-84eb-40ab-8c54-ece37435acba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:53.797684 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dbb81f9a-84eb-40ab-8c54-ece37435acba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:53.799095 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dbb81f9a-84eb-40ab-8c54-ece37435acba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:53.800326 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-dbb81f9a-84eb-40ab-8c54-ece37435acba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.158513 Oct 04 09:00:53.800889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 449/947] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:00:53 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:00:54.825866 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8335aa4c-1953-4514-9174-20a12472fff0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:54.826588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8335aa4c-1953-4514-9174-20a12472fff0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:54.833460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8335aa4c-1953-4514-9174-20a12472fff0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:54.833961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8335aa4c-1953-4514-9174-20a12472fff0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:54.834385 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8335aa4c-1953-4514-9174-20a12472fff0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:54.835091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8335aa4c-1953-4514-9174-20a12472fff0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:54.835520 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8335aa4c-1953-4514-9174-20a12472fff0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:54.835967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8335aa4c-1953-4514-9174-20a12472fff0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:54.971747 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8335aa4c-1953-4514-9174-20a12472fff0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:54.980329 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8335aa4c-1953-4514-9174-20a12472fff0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:54.981776 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8335aa4c-1953-4514-9174-20a12472fff0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:54.983013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8335aa4c-1953-4514-9174-20a12472fff0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.161223 Oct 04 09:00:54.983554 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 499/948] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:00:54 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:00:56.009487 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c58c9aba-8888-4d36-9047-f2a4bd2e53fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:56.010195 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c58c9aba-8888-4d36-9047-f2a4bd2e53fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:56.017118 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c58c9aba-8888-4d36-9047-f2a4bd2e53fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:56.017610 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c58c9aba-8888-4d36-9047-f2a4bd2e53fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:56.018052 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c58c9aba-8888-4d36-9047-f2a4bd2e53fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:56.018751 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c58c9aba-8888-4d36-9047-f2a4bd2e53fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:56.019209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c58c9aba-8888-4d36-9047-f2a4bd2e53fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:56.019637 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c58c9aba-8888-4d36-9047-f2a4bd2e53fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:56.159779 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c58c9aba-8888-4d36-9047-f2a4bd2e53fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:56.168249 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c58c9aba-8888-4d36-9047-f2a4bd2e53fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:56.169693 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c58c9aba-8888-4d36-9047-f2a4bd2e53fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:56.170913 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c58c9aba-8888-4d36-9047-f2a4bd2e53fd tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.165551 Oct 04 09:00:56.171477 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 450/949] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:00:56 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:00:57.196180 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4e2a7400-113c-4c0f-88c0-215db122b2df tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:57.196678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4e2a7400-113c-4c0f-88c0-215db122b2df tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:57.204130 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e2a7400-113c-4c0f-88c0-215db122b2df tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:57.204616 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e2a7400-113c-4c0f-88c0-215db122b2df tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:57.205045 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e2a7400-113c-4c0f-88c0-215db122b2df tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:57.205749 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e2a7400-113c-4c0f-88c0-215db122b2df tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:57.206214 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e2a7400-113c-4c0f-88c0-215db122b2df tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:57.206627 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e2a7400-113c-4c0f-88c0-215db122b2df tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:57.356404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4e2a7400-113c-4c0f-88c0-215db122b2df tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:57.365168 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4e2a7400-113c-4c0f-88c0-215db122b2df tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:57.366630 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4e2a7400-113c-4c0f-88c0-215db122b2df tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:57.367784 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4e2a7400-113c-4c0f-88c0-215db122b2df tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.175888 Oct 04 09:00:57.368730 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 500/950] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:00:57 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:00:58.407871 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-103ab2fa-10f0-419e-93f0-61a00fce2f5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:58.408610 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-103ab2fa-10f0-419e-93f0-61a00fce2f5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:58.417551 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-103ab2fa-10f0-419e-93f0-61a00fce2f5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:58.422306 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-103ab2fa-10f0-419e-93f0-61a00fce2f5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:58.422860 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-103ab2fa-10f0-419e-93f0-61a00fce2f5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:58.423770 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-103ab2fa-10f0-419e-93f0-61a00fce2f5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:58.424248 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-103ab2fa-10f0-419e-93f0-61a00fce2f5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:58.425018 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-103ab2fa-10f0-419e-93f0-61a00fce2f5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:58.564808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-103ab2fa-10f0-419e-93f0-61a00fce2f5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:58.573240 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-103ab2fa-10f0-419e-93f0-61a00fce2f5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:58.574662 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-103ab2fa-10f0-419e-93f0-61a00fce2f5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:58.575817 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-103ab2fa-10f0-419e-93f0-61a00fce2f5c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.184490 Oct 04 09:00:58.576414 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 451/951] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:00:58 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:00:59.605215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-59ef389b-f6c1-4dda-ac42-33bae087a988 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:59.606216 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-59ef389b-f6c1-4dda-ac42-33bae087a988 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:59.617220 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-59ef389b-f6c1-4dda-ac42-33bae087a988 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:59.618349 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-59ef389b-f6c1-4dda-ac42-33bae087a988 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:59.619183 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-59ef389b-f6c1-4dda-ac42-33bae087a988 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:59.620492 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-59ef389b-f6c1-4dda-ac42-33bae087a988 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:59.621298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-59ef389b-f6c1-4dda-ac42-33bae087a988 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:59.622006 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-59ef389b-f6c1-4dda-ac42-33bae087a988 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:59.756116 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-59ef389b-f6c1-4dda-ac42-33bae087a988 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:59.769725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-59ef389b-f6c1-4dda-ac42-33bae087a988 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:59.772117 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-59ef389b-f6c1-4dda-ac42-33bae087a988 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:59.773963 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-59ef389b-f6c1-4dda-ac42-33bae087a988 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.174981 Oct 04 09:00:59.774780 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 501/952] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:00:59 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:00.805093 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4699acec-9c83-4bf2-9aa9-a2904c628762 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:00.806081 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4699acec-9c83-4bf2-9aa9-a2904c628762 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:00.817291 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4699acec-9c83-4bf2-9aa9-a2904c628762 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:00.818241 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4699acec-9c83-4bf2-9aa9-a2904c628762 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:00.818962 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4699acec-9c83-4bf2-9aa9-a2904c628762 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:00.820133 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4699acec-9c83-4bf2-9aa9-a2904c628762 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:00.820883 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4699acec-9c83-4bf2-9aa9-a2904c628762 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:00.821584 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4699acec-9c83-4bf2-9aa9-a2904c628762 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:00.959415 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4699acec-9c83-4bf2-9aa9-a2904c628762 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:00.967744 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4699acec-9c83-4bf2-9aa9-a2904c628762 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:00.969224 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4699acec-9c83-4bf2-9aa9-a2904c628762 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:00.970404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4699acec-9c83-4bf2-9aa9-a2904c628762 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.171976 Oct 04 09:01:00.970929 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 452/953] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:00 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:01.996552 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0a073c74-7042-423c-b27f-e5623b64c40a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:01.997170 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0a073c74-7042-423c-b27f-e5623b64c40a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:02.004315 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a073c74-7042-423c-b27f-e5623b64c40a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:02.004803 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a073c74-7042-423c-b27f-e5623b64c40a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:02.005236 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a073c74-7042-423c-b27f-e5623b64c40a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:02.005930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a073c74-7042-423c-b27f-e5623b64c40a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:02.006383 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a073c74-7042-423c-b27f-e5623b64c40a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:02.006806 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0a073c74-7042-423c-b27f-e5623b64c40a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:02.145020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0a073c74-7042-423c-b27f-e5623b64c40a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:02.156408 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0a073c74-7042-423c-b27f-e5623b64c40a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:02.157999 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0a073c74-7042-423c-b27f-e5623b64c40a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:02.159160 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0a073c74-7042-423c-b27f-e5623b64c40a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.167092 Oct 04 09:01:02.159692 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 502/954] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:01 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:03.183816 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1dc45108-21df-4851-b6a8-099ffa0c5953 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:03.189675 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1dc45108-21df-4851-b6a8-099ffa0c5953 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:03.192397 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:03.197577 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1dc45108-21df-4851-b6a8-099ffa0c5953 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:03.197991 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1dc45108-21df-4851-b6a8-099ffa0c5953 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:03.198428 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1dc45108-21df-4851-b6a8-099ffa0c5953 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:03.199134 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1dc45108-21df-4851-b6a8-099ffa0c5953 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:03.199609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1dc45108-21df-4851-b6a8-099ffa0c5953 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:03.200065 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1dc45108-21df-4851-b6a8-099ffa0c5953 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:03.581573 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1dc45108-21df-4851-b6a8-099ffa0c5953 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:03.589855 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1dc45108-21df-4851-b6a8-099ffa0c5953 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:03.591296 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1dc45108-21df-4851-b6a8-099ffa0c5953 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:03.592504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1dc45108-21df-4851-b6a8-099ffa0c5953 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.412589 Oct 04 09:01:03.593074 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 453/955] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:03 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:04.620594 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-fbd540b9-1ea6-4202-be58-1e7b1cd08b3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:04.621281 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-fbd540b9-1ea6-4202-be58-1e7b1cd08b3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:04.624163 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:04.630765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fbd540b9-1ea6-4202-be58-1e7b1cd08b3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:04.631318 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fbd540b9-1ea6-4202-be58-1e7b1cd08b3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:04.631827 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fbd540b9-1ea6-4202-be58-1e7b1cd08b3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:04.632704 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fbd540b9-1ea6-4202-be58-1e7b1cd08b3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:04.633241 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fbd540b9-1ea6-4202-be58-1e7b1cd08b3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:04.633740 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fbd540b9-1ea6-4202-be58-1e7b1cd08b3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:04.767749 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-fbd540b9-1ea6-4202-be58-1e7b1cd08b3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:04.775798 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-fbd540b9-1ea6-4202-be58-1e7b1cd08b3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:04.777264 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-fbd540b9-1ea6-4202-be58-1e7b1cd08b3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:04.778421 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-fbd540b9-1ea6-4202-be58-1e7b1cd08b3a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.163300 Oct 04 09:01:04.779014 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 503/956] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:04 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:05.803674 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-bde039bd-7bf0-4c0f-8e08-ec42d4acc089 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:05.804177 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-bde039bd-7bf0-4c0f-8e08-ec42d4acc089 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:05.810754 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bde039bd-7bf0-4c0f-8e08-ec42d4acc089 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:05.811254 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bde039bd-7bf0-4c0f-8e08-ec42d4acc089 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:05.811729 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bde039bd-7bf0-4c0f-8e08-ec42d4acc089 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:05.812441 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bde039bd-7bf0-4c0f-8e08-ec42d4acc089 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:05.812975 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bde039bd-7bf0-4c0f-8e08-ec42d4acc089 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:05.813484 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-bde039bd-7bf0-4c0f-8e08-ec42d4acc089 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:05.991723 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-bde039bd-7bf0-4c0f-8e08-ec42d4acc089 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:06.000381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-bde039bd-7bf0-4c0f-8e08-ec42d4acc089 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:06.001858 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-bde039bd-7bf0-4c0f-8e08-ec42d4acc089 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:06.003061 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-bde039bd-7bf0-4c0f-8e08-ec42d4acc089 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.203423 Oct 04 09:01:06.003628 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 454/957] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:05 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:07.028861 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-20ad3477-9cdf-473c-b37e-ca81a3c1b12e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:07.029477 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-20ad3477-9cdf-473c-b37e-ca81a3c1b12e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:07.036236 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-20ad3477-9cdf-473c-b37e-ca81a3c1b12e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:07.036727 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-20ad3477-9cdf-473c-b37e-ca81a3c1b12e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:07.037164 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-20ad3477-9cdf-473c-b37e-ca81a3c1b12e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:07.037857 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-20ad3477-9cdf-473c-b37e-ca81a3c1b12e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:07.038309 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-20ad3477-9cdf-473c-b37e-ca81a3c1b12e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:07.038770 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-20ad3477-9cdf-473c-b37e-ca81a3c1b12e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:07.175825 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-20ad3477-9cdf-473c-b37e-ca81a3c1b12e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:07.184542 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-20ad3477-9cdf-473c-b37e-ca81a3c1b12e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:07.185886 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-20ad3477-9cdf-473c-b37e-ca81a3c1b12e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:07.187058 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-20ad3477-9cdf-473c-b37e-ca81a3c1b12e tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.162170 Oct 04 09:01:07.187576 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 504/958] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:07 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:08.212472 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-375f5463-34e0-4c1a-a226-98f118bb58ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:08.213041 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-375f5463-34e0-4c1a-a226-98f118bb58ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:08.219993 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-375f5463-34e0-4c1a-a226-98f118bb58ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:08.220469 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-375f5463-34e0-4c1a-a226-98f118bb58ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:08.221059 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-375f5463-34e0-4c1a-a226-98f118bb58ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:08.221759 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-375f5463-34e0-4c1a-a226-98f118bb58ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:08.222201 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-375f5463-34e0-4c1a-a226-98f118bb58ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:08.222623 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-375f5463-34e0-4c1a-a226-98f118bb58ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:08.366524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-375f5463-34e0-4c1a-a226-98f118bb58ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:08.376282 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-375f5463-34e0-4c1a-a226-98f118bb58ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:08.377938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-375f5463-34e0-4c1a-a226-98f118bb58ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:08.379123 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-375f5463-34e0-4c1a-a226-98f118bb58ef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.170827 Oct 04 09:01:08.387978 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 455/959] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:08 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:09.408849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8236db36-9165-46ef-9f0e-f64c453963b8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:09.409491 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8236db36-9165-46ef-9f0e-f64c453963b8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:09.417151 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8236db36-9165-46ef-9f0e-f64c453963b8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:09.417686 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8236db36-9165-46ef-9f0e-f64c453963b8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:09.418172 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8236db36-9165-46ef-9f0e-f64c453963b8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:09.418936 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8236db36-9165-46ef-9f0e-f64c453963b8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:09.419400 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8236db36-9165-46ef-9f0e-f64c453963b8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:09.420298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8236db36-9165-46ef-9f0e-f64c453963b8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:09.424488 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=100 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:09.551817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8236db36-9165-46ef-9f0e-f64c453963b8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:09.560208 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8236db36-9165-46ef-9f0e-f64c453963b8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:09.561643 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8236db36-9165-46ef-9f0e-f64c453963b8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:09.562818 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8236db36-9165-46ef-9f0e-f64c453963b8 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1743 microversion: 2.20 time: 0.160154 Oct 04 09:01:09.563379 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 505/960] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:09 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:10.589807 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1ed77647-23b0-4a98-82b8-7e4b4488fc56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:10.590520 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1ed77647-23b0-4a98-82b8-7e4b4488fc56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:10.598634 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1ed77647-23b0-4a98-82b8-7e4b4488fc56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:10.599284 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1ed77647-23b0-4a98-82b8-7e4b4488fc56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:10.599796 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1ed77647-23b0-4a98-82b8-7e4b4488fc56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:10.600697 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1ed77647-23b0-4a98-82b8-7e4b4488fc56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:10.601227 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1ed77647-23b0-4a98-82b8-7e4b4488fc56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:10.601723 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1ed77647-23b0-4a98-82b8-7e4b4488fc56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:10.606612 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:10.753166 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1ed77647-23b0-4a98-82b8-7e4b4488fc56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:10.762659 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1ed77647-23b0-4a98-82b8-7e4b4488fc56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:10.764246 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1ed77647-23b0-4a98-82b8-7e4b4488fc56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:10.765417 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1ed77647-23b0-4a98-82b8-7e4b4488fc56 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1743 microversion: 2.20 time: 0.180501 Oct 04 09:01:10.765976 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 456/961] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:10 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:11.791361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e4bbb7f5-e8b9-4388-a6ae-5b4746a6b43a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:11.791997 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e4bbb7f5-e8b9-4388-a6ae-5b4746a6b43a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:11.798486 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4bbb7f5-e8b9-4388-a6ae-5b4746a6b43a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:11.798943 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4bbb7f5-e8b9-4388-a6ae-5b4746a6b43a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:11.799368 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4bbb7f5-e8b9-4388-a6ae-5b4746a6b43a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:11.800083 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4bbb7f5-e8b9-4388-a6ae-5b4746a6b43a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:11.800527 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4bbb7f5-e8b9-4388-a6ae-5b4746a6b43a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:11.800929 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4bbb7f5-e8b9-4388-a6ae-5b4746a6b43a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:11.945456 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e4bbb7f5-e8b9-4388-a6ae-5b4746a6b43a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:11.953947 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e4bbb7f5-e8b9-4388-a6ae-5b4746a6b43a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:11.955480 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e4bbb7f5-e8b9-4388-a6ae-5b4746a6b43a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:11.956762 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e4bbb7f5-e8b9-4388-a6ae-5b4746a6b43a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1743 microversion: 2.20 time: 0.169620 Oct 04 09:01:11.957322 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 506/962] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:11 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:12.985345 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f9b445bf-25cf-4784-814c-d23550bec8c6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:12.986087 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f9b445bf-25cf-4784-814c-d23550bec8c6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:12.992966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9b445bf-25cf-4784-814c-d23550bec8c6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:12.993797 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9b445bf-25cf-4784-814c-d23550bec8c6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:12.994234 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9b445bf-25cf-4784-814c-d23550bec8c6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:12.994928 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9b445bf-25cf-4784-814c-d23550bec8c6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:12.995378 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9b445bf-25cf-4784-814c-d23550bec8c6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:12.995810 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9b445bf-25cf-4784-814c-d23550bec8c6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:13.131813 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f9b445bf-25cf-4784-814c-d23550bec8c6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:13.140320 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f9b445bf-25cf-4784-814c-d23550bec8c6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:13.141776 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f9b445bf-25cf-4784-814c-d23550bec8c6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:13.142910 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f9b445bf-25cf-4784-814c-d23550bec8c6 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1743 microversion: 2.20 time: 0.164073 Oct 04 09:01:13.143476 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 457/963] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:12 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:13.365182 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-7611cf1a-f592-49b1-9407-b6eb1f06f736 req-e666e183-61ba-4833-9422-5d04e8102794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92654e2b-1d8a-4564-8a00-e659b6ae6ec9", "name": "network-vif-plugged", "status": "completed", "tag": "f2362281-c90c-4e3f-bb88-2c03bca5bd71"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:13.376601 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-7611cf1a-f592-49b1-9407-b6eb1f06f736 req-e666e183-61ba-4833-9422-5d04e8102794 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:13.377247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-7611cf1a-f592-49b1-9407-b6eb1f06f736 req-e666e183-61ba-4833-9422-5d04e8102794 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:13.377672 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-7611cf1a-f592-49b1-9407-b6eb1f06f736 req-e666e183-61ba-4833-9422-5d04e8102794 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:13.389242 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-7611cf1a-f592-49b1-9407-b6eb1f06f736 req-e666e183-61ba-4833-9422-5d04e8102794 service nova] Creating event network-vif-plugged:f2362281-c90c-4e3f-bb88-2c03bca5bd71 for instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 on hv-cinder-84456 Oct 04 09:01:13.394469 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-7611cf1a-f592-49b1-9407-b6eb1f06f736 req-e666e183-61ba-4833-9422-5d04e8102794 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033036 Oct 04 09:01:13.395138 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 507/964] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:01:14.169458 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c1480378-941e-4faf-83f2-e1f36e45da00 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:14.172247 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c1480378-941e-4faf-83f2-e1f36e45da00 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:14.179023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c1480378-941e-4faf-83f2-e1f36e45da00 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:14.180200 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c1480378-941e-4faf-83f2-e1f36e45da00 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:14.181509 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c1480378-941e-4faf-83f2-e1f36e45da00 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:14.182420 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c1480378-941e-4faf-83f2-e1f36e45da00 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:14.182702 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c1480378-941e-4faf-83f2-e1f36e45da00 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:14.183131 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c1480378-941e-4faf-83f2-e1f36e45da00 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:14.334958 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c1480378-941e-4faf-83f2-e1f36e45da00 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:14.347661 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c1480378-941e-4faf-83f2-e1f36e45da00 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:14.349976 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c1480378-941e-4faf-83f2-e1f36e45da00 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:14.351781 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c1480378-941e-4faf-83f2-e1f36e45da00 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1743 microversion: 2.20 time: 0.186581 Oct 04 09:01:14.352724 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 458/965] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:14 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1743 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:15.381950 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6867a028-d12b-4933-adb0-b0b42d348dc5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:15.383232 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6867a028-d12b-4933-adb0-b0b42d348dc5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:15.389567 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6867a028-d12b-4933-adb0-b0b42d348dc5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:15.390055 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6867a028-d12b-4933-adb0-b0b42d348dc5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:15.390485 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6867a028-d12b-4933-adb0-b0b42d348dc5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:15.391359 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6867a028-d12b-4933-adb0-b0b42d348dc5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:15.391838 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6867a028-d12b-4933-adb0-b0b42d348dc5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:15.392443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6867a028-d12b-4933-adb0-b0b42d348dc5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:15.534192 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6867a028-d12b-4933-adb0-b0b42d348dc5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:15.544656 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6867a028-d12b-4933-adb0-b0b42d348dc5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:15.546466 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6867a028-d12b-4933-adb0-b0b42d348dc5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:15.548206 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6867a028-d12b-4933-adb0-b0b42d348dc5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1738 microversion: 2.20 time: 0.170956 Oct 04 09:01:15.548959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 508/966] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:15 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:16.574668 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e7385271-a566-436b-97b1-a1cd419995c7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:16.575282 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e7385271-a566-436b-97b1-a1cd419995c7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:16.596282 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e7385271-a566-436b-97b1-a1cd419995c7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:16.598068 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e7385271-a566-436b-97b1-a1cd419995c7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:16.598581 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e7385271-a566-436b-97b1-a1cd419995c7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:16.599688 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e7385271-a566-436b-97b1-a1cd419995c7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:16.600370 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e7385271-a566-436b-97b1-a1cd419995c7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:16.601013 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e7385271-a566-436b-97b1-a1cd419995c7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:16.817859 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e7385271-a566-436b-97b1-a1cd419995c7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:16.828420 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e7385271-a566-436b-97b1-a1cd419995c7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:16.829776 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e7385271-a566-436b-97b1-a1cd419995c7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:16.830964 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e7385271-a566-436b-97b1-a1cd419995c7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1738 microversion: 2.20 time: 0.260292 Oct 04 09:01:16.834779 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 459/967] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:16 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1738 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:17.859015 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-938c7c05-b228-4b5c-ba59-01e2260cc68a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:17.859725 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-938c7c05-b228-4b5c-ba59-01e2260cc68a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:17.868702 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-938c7c05-b228-4b5c-ba59-01e2260cc68a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:17.876775 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-938c7c05-b228-4b5c-ba59-01e2260cc68a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:17.877236 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-938c7c05-b228-4b5c-ba59-01e2260cc68a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:17.878015 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-938c7c05-b228-4b5c-ba59-01e2260cc68a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:17.878647 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-938c7c05-b228-4b5c-ba59-01e2260cc68a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:17.879388 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-938c7c05-b228-4b5c-ba59-01e2260cc68a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:18.061746 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-938c7c05-b228-4b5c-ba59-01e2260cc68a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:18.070417 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-938c7c05-b228-4b5c-ba59-01e2260cc68a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:18.071877 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-938c7c05-b228-4b5c-ba59-01e2260cc68a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:18.073106 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-938c7c05-b228-4b5c-ba59-01e2260cc68a tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1738 microversion: 2.20 time: 0.218421 Oct 04 09:01:18.073966 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 509/968] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:17 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:19.099303 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d25bbfa8-d3a1-47c5-820d-acfd82338173 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:19.099915 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d25bbfa8-d3a1-47c5-820d-acfd82338173 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:19.106442 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d25bbfa8-d3a1-47c5-820d-acfd82338173 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:19.107069 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d25bbfa8-d3a1-47c5-820d-acfd82338173 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:19.107326 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d25bbfa8-d3a1-47c5-820d-acfd82338173 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:19.108139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d25bbfa8-d3a1-47c5-820d-acfd82338173 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:19.108705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d25bbfa8-d3a1-47c5-820d-acfd82338173 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:19.109055 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d25bbfa8-d3a1-47c5-820d-acfd82338173 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:19.263935 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d25bbfa8-d3a1-47c5-820d-acfd82338173 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:19.273503 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d25bbfa8-d3a1-47c5-820d-acfd82338173 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:19.274947 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d25bbfa8-d3a1-47c5-820d-acfd82338173 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:19.276161 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d25bbfa8-d3a1-47c5-820d-acfd82338173 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1738 microversion: 2.20 time: 0.181029 Oct 04 09:01:19.277091 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 460/969] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:19 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:19.862291 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1284754326", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452"}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:19.925506 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.network.neutron [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] validate_networks() for None {{(pid=142438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:01:20.242647 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Flavor limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:01:20.243285 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Image limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:01:20.244296 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Flavor pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:01:20.244882 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Image pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:01:20.245557 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:01:20.255972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:20.256709 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:20.257665 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:20.258393 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:20.258841 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:20.259261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:20.278147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Getting quotas for project 4cefdaaad09e451dbb9e5e735845a9cc. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:01:20.282455 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Getting quotas for user 9d49791d656a4cbaaf30609253a0e565 and project 4cefdaaad09e451dbb9e5e735845a9cc. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:01:20.295166 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Going to run 1 instances... {{(pid=142438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:01:20.297457 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:01:20.304299 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9de5e13c-283a-4e3c-99e4-1b2c79768b17 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:20.305507 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9de5e13c-283a-4e3c-99e4-1b2c79768b17 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:20.313608 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9de5e13c-283a-4e3c-99e4-1b2c79768b17 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:20.314074 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9de5e13c-283a-4e3c-99e4-1b2c79768b17 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:20.314516 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9de5e13c-283a-4e3c-99e4-1b2c79768b17 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:20.315223 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9de5e13c-283a-4e3c-99e4-1b2c79768b17 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:20.315677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9de5e13c-283a-4e3c-99e4-1b2c79768b17 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:20.316141 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9de5e13c-283a-4e3c-99e4-1b2c79768b17 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:20.344158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [bd1ce334-b8b6-487f-9bc1-a36cdae4afd4] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 09:01:20.500883 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9de5e13c-283a-4e3c-99e4-1b2c79768b17 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:20.510579 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9de5e13c-283a-4e3c-99e4-1b2c79768b17 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:20.512503 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9de5e13c-283a-4e3c-99e4-1b2c79768b17 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:20.513821 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9de5e13c-283a-4e3c-99e4-1b2c79768b17 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1738 microversion: 2.20 time: 0.213533 Oct 04 09:01:20.514458 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 461/970] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:20 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:21.354513 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO oslo.messaging._drivers.impl_rabbit [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [bd1ce334-b8b6-487f-9bc1-a36cdae4afd4] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 48668. Oct 04 09:01:21.362268 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f940712a-59d3-4291-8155-553804f1de48 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.503857 Oct 04 09:01:21.363173 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 510/971] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 09:01:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 09:01:21.377068 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b7ca308b-f4e5-40db-8382-4d32c76e0a8e tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:21.378245 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b7ca308b-f4e5-40db-8382-4d32c76e0a8e tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:21.460763 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b7ca308b-f4e5-40db-8382-4d32c76e0a8e tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:21.468621 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b7ca308b-f4e5-40db-8382-4d32c76e0a8e tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1215 microversion: 2.1 time: 0.097370 Oct 04 09:01:21.469730 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 462/972] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:21 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:21.541218 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-402e903e-72ce-4d61-ac51-067a55fa5ea0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:21.542038 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-402e903e-72ce-4d61-ac51-067a55fa5ea0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:21.550492 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-402e903e-72ce-4d61-ac51-067a55fa5ea0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:21.551237 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-402e903e-72ce-4d61-ac51-067a55fa5ea0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:21.551745 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-402e903e-72ce-4d61-ac51-067a55fa5ea0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:21.552555 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-402e903e-72ce-4d61-ac51-067a55fa5ea0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:21.553088 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-402e903e-72ce-4d61-ac51-067a55fa5ea0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:21.553580 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-402e903e-72ce-4d61-ac51-067a55fa5ea0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:21.693103 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-402e903e-72ce-4d61-ac51-067a55fa5ea0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:21.702783 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-402e903e-72ce-4d61-ac51-067a55fa5ea0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:21.704251 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-402e903e-72ce-4d61-ac51-067a55fa5ea0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:21.705514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-402e903e-72ce-4d61-ac51-067a55fa5ea0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1738 microversion: 2.20 time: 0.168293 Oct 04 09:01:21.720594 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 511/973] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:21 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:22.491550 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-70561fbe-d1bb-4e2e-a16c-74ed0c3c7c45 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:22.492895 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-70561fbe-d1bb-4e2e-a16c-74ed0c3c7c45 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:22.501249 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-70561fbe-d1bb-4e2e-a16c-74ed0c3c7c45 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:22.502051 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-70561fbe-d1bb-4e2e-a16c-74ed0c3c7c45 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:22.502662 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-70561fbe-d1bb-4e2e-a16c-74ed0c3c7c45 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:22.503555 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-70561fbe-d1bb-4e2e-a16c-74ed0c3c7c45 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:22.504222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-70561fbe-d1bb-4e2e-a16c-74ed0c3c7c45 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:22.504653 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-70561fbe-d1bb-4e2e-a16c-74ed0c3c7c45 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:22.566184 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-70561fbe-d1bb-4e2e-a16c-74ed0c3c7c45 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:22.574423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-70561fbe-d1bb-4e2e-a16c-74ed0c3c7c45 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1267 microversion: 2.1 time: 0.086878 Oct 04 09:01:22.575213 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 463/974] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:22 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:22.733224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b9cf4b7b-2636-4cc3-88a0-51cf3573a7b1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:22.734675 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b9cf4b7b-2636-4cc3-88a0-51cf3573a7b1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:22.743793 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9cf4b7b-2636-4cc3-88a0-51cf3573a7b1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:22.744786 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9cf4b7b-2636-4cc3-88a0-51cf3573a7b1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:22.745470 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9cf4b7b-2636-4cc3-88a0-51cf3573a7b1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:22.746398 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9cf4b7b-2636-4cc3-88a0-51cf3573a7b1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:22.747057 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9cf4b7b-2636-4cc3-88a0-51cf3573a7b1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:22.747840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9cf4b7b-2636-4cc3-88a0-51cf3573a7b1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:22.924389 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b9cf4b7b-2636-4cc3-88a0-51cf3573a7b1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:22.936678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b9cf4b7b-2636-4cc3-88a0-51cf3573a7b1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:22.938814 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b9cf4b7b-2636-4cc3-88a0-51cf3573a7b1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:22.940370 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b9cf4b7b-2636-4cc3-88a0-51cf3573a7b1 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1738 microversion: 2.20 time: 0.211717 Oct 04 09:01:22.941143 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 512/975] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:22 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 09:01:23.604386 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d0a2e761-d288-4065-9789-79fdfb9b68f6 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:23.605608 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d0a2e761-d288-4065-9789-79fdfb9b68f6 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:23.619538 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0a2e761-d288-4065-9789-79fdfb9b68f6 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:23.622257 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0a2e761-d288-4065-9789-79fdfb9b68f6 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:23.622876 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0a2e761-d288-4065-9789-79fdfb9b68f6 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:23.623821 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0a2e761-d288-4065-9789-79fdfb9b68f6 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:23.624468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0a2e761-d288-4065-9789-79fdfb9b68f6 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:23.625092 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0a2e761-d288-4065-9789-79fdfb9b68f6 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:23.691159 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d0a2e761-d288-4065-9789-79fdfb9b68f6 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:23.701377 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d0a2e761-d288-4065-9789-79fdfb9b68f6 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1273 microversion: 2.1 time: 0.107193 Oct 04 09:01:23.708267 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 464/976] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:23 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:23.975434 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-572ed014-9261-4ff1-968d-ecb5d3d64d8c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:23.979289 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-572ed014-9261-4ff1-968d-ecb5d3d64d8c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:24.003930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-572ed014-9261-4ff1-968d-ecb5d3d64d8c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:24.004716 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-572ed014-9261-4ff1-968d-ecb5d3d64d8c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:24.006578 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-572ed014-9261-4ff1-968d-ecb5d3d64d8c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:24.007525 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-572ed014-9261-4ff1-968d-ecb5d3d64d8c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:24.009028 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-572ed014-9261-4ff1-968d-ecb5d3d64d8c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:24.009786 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-572ed014-9261-4ff1-968d-ecb5d3d64d8c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:24.190012 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-572ed014-9261-4ff1-968d-ecb5d3d64d8c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:24.202015 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-572ed014-9261-4ff1-968d-ecb5d3d64d8c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:24.204219 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-572ed014-9261-4ff1-968d-ecb5d3d64d8c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:24.206874 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-572ed014-9261-4ff1-968d-ecb5d3d64d8c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1738 microversion: 2.20 time: 0.240676 Oct 04 09:01:24.221366 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 513/977] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:23 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:24.725536 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-76c5fbf9-6850-445e-aa34-58f68f414a7f tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:24.726810 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-76c5fbf9-6850-445e-aa34-58f68f414a7f tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:24.741151 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76c5fbf9-6850-445e-aa34-58f68f414a7f tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:24.745393 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76c5fbf9-6850-445e-aa34-58f68f414a7f tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:24.746002 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76c5fbf9-6850-445e-aa34-58f68f414a7f tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:24.746726 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76c5fbf9-6850-445e-aa34-58f68f414a7f tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:24.747183 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76c5fbf9-6850-445e-aa34-58f68f414a7f tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:24.750364 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76c5fbf9-6850-445e-aa34-58f68f414a7f tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:24.822842 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-1ebcfbf5-3ed7-40c7-aea6-0599e6d02019 req-a8f7d463-a449-4e10-8318-4d01b91444cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1061f9-f871-41c0-bb00-286c487e6ed7", "tag": "7b676b49-5509-47b9-bc29-7fdd5e33fdd1"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:24.841303 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-1ebcfbf5-3ed7-40c7-aea6-0599e6d02019 req-a8f7d463-a449-4e10-8318-4d01b91444cc service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:24.842082 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-1ebcfbf5-3ed7-40c7-aea6-0599e6d02019 req-a8f7d463-a449-4e10-8318-4d01b91444cc service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:24.842763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-1ebcfbf5-3ed7-40c7-aea6-0599e6d02019 req-a8f7d463-a449-4e10-8318-4d01b91444cc service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:24.867853 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-1ebcfbf5-3ed7-40c7-aea6-0599e6d02019 req-a8f7d463-a449-4e10-8318-4d01b91444cc service nova] Creating event network-changed:7b676b49-5509-47b9-bc29-7fdd5e33fdd1 for instance 9f1061f9-f871-41c0-bb00-286c487e6ed7 on hv-cinder-84456 Oct 04 09:01:24.879360 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-1ebcfbf5-3ed7-40c7-aea6-0599e6d02019 req-a8f7d463-a449-4e10-8318-4d01b91444cc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060117 Oct 04 09:01:24.879994 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 514/978] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 09:01:24.949706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-76c5fbf9-6850-445e-aa34-58f68f414a7f tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:24.959570 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-76c5fbf9-6850-445e-aa34-58f68f414a7f tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1315 microversion: 2.1 time: 0.238515 Oct 04 09:01:24.960358 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 465/979] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:24 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:25.235272 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-28ea839c-e6ad-4c46-81f3-7fad3c990739 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:25.236047 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-28ea839c-e6ad-4c46-81f3-7fad3c990739 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:25.242583 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-28ea839c-e6ad-4c46-81f3-7fad3c990739 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:25.243064 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-28ea839c-e6ad-4c46-81f3-7fad3c990739 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:25.243840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-28ea839c-e6ad-4c46-81f3-7fad3c990739 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:25.244558 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-28ea839c-e6ad-4c46-81f3-7fad3c990739 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:25.245005 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-28ea839c-e6ad-4c46-81f3-7fad3c990739 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:25.245424 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-28ea839c-e6ad-4c46-81f3-7fad3c990739 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:25.389241 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-28ea839c-e6ad-4c46-81f3-7fad3c990739 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:25.398877 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-28ea839c-e6ad-4c46-81f3-7fad3c990739 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:25.401140 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-28ea839c-e6ad-4c46-81f3-7fad3c990739 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:25.402638 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-28ea839c-e6ad-4c46-81f3-7fad3c990739 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1738 microversion: 2.20 time: 0.172243 Oct 04 09:01:25.403526 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 515/980] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:25 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:25.983393 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-45fdd0fd-f123-4869-b58b-f6bd30352c06 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:25.984219 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-45fdd0fd-f123-4869-b58b-f6bd30352c06 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:25.991055 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-45fdd0fd-f123-4869-b58b-f6bd30352c06 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:25.991607 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-45fdd0fd-f123-4869-b58b-f6bd30352c06 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:25.992353 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-45fdd0fd-f123-4869-b58b-f6bd30352c06 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:25.993194 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-45fdd0fd-f123-4869-b58b-f6bd30352c06 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:25.994141 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-45fdd0fd-f123-4869-b58b-f6bd30352c06 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:25.994627 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-45fdd0fd-f123-4869-b58b-f6bd30352c06 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:26.130265 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-45fdd0fd-f123-4869-b58b-f6bd30352c06 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:26.139925 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-45fdd0fd-f123-4869-b58b-f6bd30352c06 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1315 microversion: 2.1 time: 0.160777 Oct 04 09:01:26.142842 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 466/981] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:25 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:26.431092 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f21eade9-4682-4285-9b93-d3a53ff1064b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:26.431745 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f21eade9-4682-4285-9b93-d3a53ff1064b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:26.440081 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f21eade9-4682-4285-9b93-d3a53ff1064b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:26.440665 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f21eade9-4682-4285-9b93-d3a53ff1064b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:26.441180 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f21eade9-4682-4285-9b93-d3a53ff1064b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:26.442003 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f21eade9-4682-4285-9b93-d3a53ff1064b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:26.442546 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f21eade9-4682-4285-9b93-d3a53ff1064b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:26.443069 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f21eade9-4682-4285-9b93-d3a53ff1064b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:26.592452 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f21eade9-4682-4285-9b93-d3a53ff1064b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:26.600879 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f21eade9-4682-4285-9b93-d3a53ff1064b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:26.602331 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f21eade9-4682-4285-9b93-d3a53ff1064b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:26.603503 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f21eade9-4682-4285-9b93-d3a53ff1064b tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1738 microversion: 2.20 time: 0.177256 Oct 04 09:01:26.604065 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 516/982] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:26 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:27.169397 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1cc960ff-a096-49cd-807a-fa7157df4ada tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:27.170461 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1cc960ff-a096-49cd-807a-fa7157df4ada tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:27.178868 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1cc960ff-a096-49cd-807a-fa7157df4ada tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:27.179360 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1cc960ff-a096-49cd-807a-fa7157df4ada tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:27.179801 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1cc960ff-a096-49cd-807a-fa7157df4ada tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:27.180528 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1cc960ff-a096-49cd-807a-fa7157df4ada tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:27.180987 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1cc960ff-a096-49cd-807a-fa7157df4ada tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:27.181416 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1cc960ff-a096-49cd-807a-fa7157df4ada tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:27.319226 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1cc960ff-a096-49cd-807a-fa7157df4ada tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:27.330770 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1cc960ff-a096-49cd-807a-fa7157df4ada tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1315 microversion: 2.1 time: 0.167703 Oct 04 09:01:27.331491 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 467/983] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:27 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:27.633383 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-cb672784-d0e5-4866-87ab-58bd49a31a92 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:27.634377 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cb672784-d0e5-4866-87ab-58bd49a31a92 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:27.644317 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb672784-d0e5-4866-87ab-58bd49a31a92 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:27.644803 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb672784-d0e5-4866-87ab-58bd49a31a92 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:27.645239 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb672784-d0e5-4866-87ab-58bd49a31a92 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:27.645929 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb672784-d0e5-4866-87ab-58bd49a31a92 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:27.646376 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb672784-d0e5-4866-87ab-58bd49a31a92 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:27.646802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb672784-d0e5-4866-87ab-58bd49a31a92 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:27.782459 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cb672784-d0e5-4866-87ab-58bd49a31a92 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:27.790551 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cb672784-d0e5-4866-87ab-58bd49a31a92 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:27.792022 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cb672784-d0e5-4866-87ab-58bd49a31a92 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:27.793189 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-cb672784-d0e5-4866-87ab-58bd49a31a92 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1738 microversion: 2.20 time: 0.166506 Oct 04 09:01:27.793750 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 517/984] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:27 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:28.363617 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2325b797-352a-419c-a0e7-ff602b2e6d74 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:28.364663 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2325b797-352a-419c-a0e7-ff602b2e6d74 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:28.376237 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2325b797-352a-419c-a0e7-ff602b2e6d74 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:28.377234 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2325b797-352a-419c-a0e7-ff602b2e6d74 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:28.377868 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2325b797-352a-419c-a0e7-ff602b2e6d74 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:28.378574 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2325b797-352a-419c-a0e7-ff602b2e6d74 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:28.379221 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2325b797-352a-419c-a0e7-ff602b2e6d74 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:28.379636 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2325b797-352a-419c-a0e7-ff602b2e6d74 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:28.517463 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2325b797-352a-419c-a0e7-ff602b2e6d74 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:28.525302 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2325b797-352a-419c-a0e7-ff602b2e6d74 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1315 microversion: 2.1 time: 0.168328 Oct 04 09:01:28.525885 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 468/985] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:28 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:28.819655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-284344bd-44ec-4d3c-948b-e7abc234f7e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:28.820255 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-284344bd-44ec-4d3c-948b-e7abc234f7e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:28.827200 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-284344bd-44ec-4d3c-948b-e7abc234f7e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:28.827687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-284344bd-44ec-4d3c-948b-e7abc234f7e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:28.828156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-284344bd-44ec-4d3c-948b-e7abc234f7e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:28.828849 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-284344bd-44ec-4d3c-948b-e7abc234f7e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:28.829299 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-284344bd-44ec-4d3c-948b-e7abc234f7e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:28.829717 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-284344bd-44ec-4d3c-948b-e7abc234f7e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:28.966016 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-284344bd-44ec-4d3c-948b-e7abc234f7e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:28.974837 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-284344bd-44ec-4d3c-948b-e7abc234f7e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:28.976283 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-284344bd-44ec-4d3c-948b-e7abc234f7e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:28.977457 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-284344bd-44ec-4d3c-948b-e7abc234f7e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1720 microversion: 2.20 time: 0.161973 Oct 04 09:01:28.978016 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 518/986] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:28 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:29.548925 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-db7f8f80-3619-46f6-8f51-4134f16f8866 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:29.549544 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-db7f8f80-3619-46f6-8f51-4134f16f8866 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:29.557300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-db7f8f80-3619-46f6-8f51-4134f16f8866 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:29.557300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-db7f8f80-3619-46f6-8f51-4134f16f8866 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:29.557631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-db7f8f80-3619-46f6-8f51-4134f16f8866 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:29.558311 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-db7f8f80-3619-46f6-8f51-4134f16f8866 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:29.558773 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-db7f8f80-3619-46f6-8f51-4134f16f8866 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:29.559202 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-db7f8f80-3619-46f6-8f51-4134f16f8866 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:29.687372 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-db7f8f80-3619-46f6-8f51-4134f16f8866 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:29.695512 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-db7f8f80-3619-46f6-8f51-4134f16f8866 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1315 microversion: 2.1 time: 0.150634 Oct 04 09:01:29.696162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 469/987] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:29 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:30.003681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b7a7961c-0e11-4a49-bacd-728bf570e5a5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:30.004418 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b7a7961c-0e11-4a49-bacd-728bf570e5a5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:30.012033 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b7a7961c-0e11-4a49-bacd-728bf570e5a5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:30.012565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b7a7961c-0e11-4a49-bacd-728bf570e5a5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:30.013044 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b7a7961c-0e11-4a49-bacd-728bf570e5a5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:30.013805 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b7a7961c-0e11-4a49-bacd-728bf570e5a5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:30.014295 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b7a7961c-0e11-4a49-bacd-728bf570e5a5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:30.014757 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b7a7961c-0e11-4a49-bacd-728bf570e5a5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:30.148128 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b7a7961c-0e11-4a49-bacd-728bf570e5a5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:30.156502 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b7a7961c-0e11-4a49-bacd-728bf570e5a5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:30.157930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b7a7961c-0e11-4a49-bacd-728bf570e5a5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:30.159094 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b7a7961c-0e11-4a49-bacd-728bf570e5a5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1720 microversion: 2.20 time: 0.159979 Oct 04 09:01:30.159650 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 519/988] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:29 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:30.722779 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1c6a361a-52ec-45fe-803d-c14b7b0b22dc tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:30.723988 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1c6a361a-52ec-45fe-803d-c14b7b0b22dc tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:30.738397 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1c6a361a-52ec-45fe-803d-c14b7b0b22dc tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:30.738890 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1c6a361a-52ec-45fe-803d-c14b7b0b22dc tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:30.739352 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1c6a361a-52ec-45fe-803d-c14b7b0b22dc tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:30.740092 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1c6a361a-52ec-45fe-803d-c14b7b0b22dc tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:30.740548 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1c6a361a-52ec-45fe-803d-c14b7b0b22dc tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:30.740972 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1c6a361a-52ec-45fe-803d-c14b7b0b22dc tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:30.893808 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1c6a361a-52ec-45fe-803d-c14b7b0b22dc tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:30.901823 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1c6a361a-52ec-45fe-803d-c14b7b0b22dc tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1315 microversion: 2.1 time: 0.185696 Oct 04 09:01:30.902391 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 470/989] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:30 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:31.188866 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f43e27e2-b459-4794-9cb2-600a67175d9f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:31.189880 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f43e27e2-b459-4794-9cb2-600a67175d9f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:31.192452 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:31.193116 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=6 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:31.199340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f43e27e2-b459-4794-9cb2-600a67175d9f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:31.199820 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f43e27e2-b459-4794-9cb2-600a67175d9f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:31.200273 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f43e27e2-b459-4794-9cb2-600a67175d9f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:31.200962 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f43e27e2-b459-4794-9cb2-600a67175d9f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:31.201408 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f43e27e2-b459-4794-9cb2-600a67175d9f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:31.201822 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f43e27e2-b459-4794-9cb2-600a67175d9f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:31.332883 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f43e27e2-b459-4794-9cb2-600a67175d9f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:31.341359 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f43e27e2-b459-4794-9cb2-600a67175d9f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:31.342783 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f43e27e2-b459-4794-9cb2-600a67175d9f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:31.343967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f43e27e2-b459-4794-9cb2-600a67175d9f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1723 microversion: 2.20 time: 0.161790 Oct 04 09:01:31.344528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 520/990] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:31 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:31.371687 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-29422a69-ebcb-4b18-adef-4d5ae17bd363 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8d0a089-51a8-4bfd-9dfc-08068a5de307"}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:31.374255 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-29422a69-ebcb-4b18-adef-4d5ae17bd363 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:31.386796 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-29422a69-ebcb-4b18-adef-4d5ae17bd363 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:31.387286 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-29422a69-ebcb-4b18-adef-4d5ae17bd363 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:31.387827 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-29422a69-ebcb-4b18-adef-4d5ae17bd363 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:31.390027 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-29422a69-ebcb-4b18-adef-4d5ae17bd363 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:31.390027 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-29422a69-ebcb-4b18-adef-4d5ae17bd363 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:31.390027 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-29422a69-ebcb-4b18-adef-4d5ae17bd363 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:31.467944 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:31.468336 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-4d478c72-da79-4bbf-8d21-18bba3a51da5 req-bbe51678-6488-45ac-807c-b7cb1d5d0ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1061f9-f871-41c0-bb00-286c487e6ed7", "name": "network-vif-plugged", "status": "completed", "tag": "7b676b49-5509-47b9-bc29-7fdd5e33fdd1"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:31.482759 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-4d478c72-da79-4bbf-8d21-18bba3a51da5 req-bbe51678-6488-45ac-807c-b7cb1d5d0ab3 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:31.484090 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-4d478c72-da79-4bbf-8d21-18bba3a51da5 req-bbe51678-6488-45ac-807c-b7cb1d5d0ab3 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:31.485112 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-4d478c72-da79-4bbf-8d21-18bba3a51da5 req-bbe51678-6488-45ac-807c-b7cb1d5d0ab3 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:31.514176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-4d478c72-da79-4bbf-8d21-18bba3a51da5 req-bbe51678-6488-45ac-807c-b7cb1d5d0ab3 service nova] Creating event network-vif-plugged:7b676b49-5509-47b9-bc29-7fdd5e33fdd1 for instance 9f1061f9-f871-41c0-bb00-286c487e6ed7 on hv-cinder-84456 Oct 04 09:01:31.519719 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-4d478c72-da79-4bbf-8d21-18bba3a51da5 req-bbe51678-6488-45ac-807c-b7cb1d5d0ab3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058064 Oct 04 09:01:31.520356 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 521/991] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:01:31.818891 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:31.832727 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-29422a69-ebcb-4b18-adef-4d5ae17bd363 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "POST /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.466465 Oct 04 09:01:31.833336 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 471/992] 10.222.0.44 () {62 vars in 1364 bytes} [Tue Oct 4 09:01:31 2022] POST /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9/os-volume_attachments => generated 188 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 09:01:31.925474 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7177fcf9-9fc8-463a-b9d5-d53db433b6cf tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:31.926314 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7177fcf9-9fc8-463a-b9d5-d53db433b6cf tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:31.933360 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7177fcf9-9fc8-463a-b9d5-d53db433b6cf tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:31.933986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7177fcf9-9fc8-463a-b9d5-d53db433b6cf tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:31.934419 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7177fcf9-9fc8-463a-b9d5-d53db433b6cf tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:31.935107 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7177fcf9-9fc8-463a-b9d5-d53db433b6cf tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:31.935547 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7177fcf9-9fc8-463a-b9d5-d53db433b6cf tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:31.935992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7177fcf9-9fc8-463a-b9d5-d53db433b6cf tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:31.962301 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-85e4dd21-b258-4730-8a83-2dc4eee051d3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:31.962800 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-85e4dd21-b258-4730-8a83-2dc4eee051d3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:31.970378 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85e4dd21-b258-4730-8a83-2dc4eee051d3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:31.971204 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85e4dd21-b258-4730-8a83-2dc4eee051d3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:31.971836 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85e4dd21-b258-4730-8a83-2dc4eee051d3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:31.973036 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85e4dd21-b258-4730-8a83-2dc4eee051d3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:31.973036 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85e4dd21-b258-4730-8a83-2dc4eee051d3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:31.973447 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85e4dd21-b258-4730-8a83-2dc4eee051d3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:32.067432 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7177fcf9-9fc8-463a-b9d5-d53db433b6cf tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:32.076036 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7177fcf9-9fc8-463a-b9d5-d53db433b6cf tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1315 microversion: 2.1 time: 0.154892 Oct 04 09:01:32.076727 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 522/993] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:31 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:32.240373 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-85e4dd21-b258-4730-8a83-2dc4eee051d3 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "DELETE /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9/os-volume_attachments/e8d0a089-51a8-4bfd-9dfc-08068a5de307" status: 202 len: 0 microversion: 2.20 time: 0.282313 Oct 04 09:01:32.241161 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 472/994] 10.222.0.44 () {60 vars in 1457 bytes} [Tue Oct 4 09:01:31 2022] DELETE /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9/os-volume_attachments/e8d0a089-51a8-4bfd-9dfc-08068a5de307 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:01:32.302000 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a535d9c5-d403-4142-8fda-9ff94dccd31c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:32.302527 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a535d9c5-d403-4142-8fda-9ff94dccd31c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:32.309177 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a535d9c5-d403-4142-8fda-9ff94dccd31c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:32.309657 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a535d9c5-d403-4142-8fda-9ff94dccd31c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:32.310085 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a535d9c5-d403-4142-8fda-9ff94dccd31c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:32.310760 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a535d9c5-d403-4142-8fda-9ff94dccd31c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:32.311206 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a535d9c5-d403-4142-8fda-9ff94dccd31c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:32.311623 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a535d9c5-d403-4142-8fda-9ff94dccd31c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:32.340942 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a535d9c5-d403-4142-8fda-9ff94dccd31c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=142438) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 09:01:32.389220 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:32.414710 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a535d9c5-d403-4142-8fda-9ff94dccd31c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "POST /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9/action" status: 202 len: 0 microversion: 2.20 time: 0.116904 Oct 04 09:01:32.415578 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 523/995] 10.222.0.44 () {62 vars in 1319 bytes} [Tue Oct 4 09:01:32 2022] POST /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:01:32.424003 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-7a60495a-f89c-4b28-8864-6fc74507f460 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:32.424887 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-7a60495a-f89c-4b28-8864-6fc74507f460 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:32.431083 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7a60495a-f89c-4b28-8864-6fc74507f460 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:32.431642 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7a60495a-f89c-4b28-8864-6fc74507f460 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:32.432118 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7a60495a-f89c-4b28-8864-6fc74507f460 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:32.432818 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7a60495a-f89c-4b28-8864-6fc74507f460 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:32.433266 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7a60495a-f89c-4b28-8864-6fc74507f460 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:32.433694 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7a60495a-f89c-4b28-8864-6fc74507f460 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:32.566482 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7a60495a-f89c-4b28-8864-6fc74507f460 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:32.575245 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7a60495a-f89c-4b28-8864-6fc74507f460 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:32.576702 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7a60495a-f89c-4b28-8864-6fc74507f460 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:32.577861 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-7a60495a-f89c-4b28-8864-6fc74507f460 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1671 microversion: 2.20 time: 0.157944 Oct 04 09:01:32.578395 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 473/996] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:32 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:33.099514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-dbc30fd8-09d9-431e-9df2-64526c00d558 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:33.100138 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-dbc30fd8-09d9-431e-9df2-64526c00d558 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:33.106231 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dbc30fd8-09d9-431e-9df2-64526c00d558 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:33.108360 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dbc30fd8-09d9-431e-9df2-64526c00d558 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:33.108825 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dbc30fd8-09d9-431e-9df2-64526c00d558 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:33.109544 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dbc30fd8-09d9-431e-9df2-64526c00d558 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:33.110004 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dbc30fd8-09d9-431e-9df2-64526c00d558 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:33.110426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dbc30fd8-09d9-431e-9df2-64526c00d558 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:33.302839 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-dbc30fd8-09d9-431e-9df2-64526c00d558 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:33.311342 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-dbc30fd8-09d9-431e-9df2-64526c00d558 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1315 microversion: 2.1 time: 0.216070 Oct 04 09:01:33.311903 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 524/997] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:33 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:33.544083 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-2c9878f8-0114-4afb-8ecc-fc8bd19fe42e req-2a355b02-ad20-4e84-90ea-fad48d4704bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92654e2b-1d8a-4564-8a00-e659b6ae6ec9", "name": "network-vif-unplugged", "status": "completed", "tag": "f2362281-c90c-4e3f-bb88-2c03bca5bd71"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:33.550657 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=44 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:33.558100 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-2c9878f8-0114-4afb-8ecc-fc8bd19fe42e req-2a355b02-ad20-4e84-90ea-fad48d4704bd service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:33.558684 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-2c9878f8-0114-4afb-8ecc-fc8bd19fe42e req-2a355b02-ad20-4e84-90ea-fad48d4704bd service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:33.559217 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-2c9878f8-0114-4afb-8ecc-fc8bd19fe42e req-2a355b02-ad20-4e84-90ea-fad48d4704bd service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:33.572270 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.compute.server_external_events [req-2c9878f8-0114-4afb-8ecc-fc8bd19fe42e req-2a355b02-ad20-4e84-90ea-fad48d4704bd service nova] Unable to find a host for instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9. Dropping event network-vif-unplugged {{(pid=142439) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 09:01:33.573118 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-2c9878f8-0114-4afb-8ecc-fc8bd19fe42e req-2a355b02-ad20-4e84-90ea-fad48d4704bd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033999 Oct 04 09:01:33.573679 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 474/998] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 09:01:33.604097 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-10c374f4-53db-4316-b0e2-1b563f4b048c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:33.604848 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-10c374f4-53db-4316-b0e2-1b563f4b048c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:33.611116 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10c374f4-53db-4316-b0e2-1b563f4b048c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:33.611599 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10c374f4-53db-4316-b0e2-1b563f4b048c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:33.612066 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10c374f4-53db-4316-b0e2-1b563f4b048c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:33.612745 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10c374f4-53db-4316-b0e2-1b563f4b048c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:33.613196 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10c374f4-53db-4316-b0e2-1b563f4b048c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:33.613618 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-10c374f4-53db-4316-b0e2-1b563f4b048c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:33.749146 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-10c374f4-53db-4316-b0e2-1b563f4b048c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:33.757612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-10c374f4-53db-4316-b0e2-1b563f4b048c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:33.759134 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-10c374f4-53db-4316-b0e2-1b563f4b048c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:33.760429 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-10c374f4-53db-4316-b0e2-1b563f4b048c tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1671 microversion: 2.20 time: 0.160344 Oct 04 09:01:33.761093 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 525/999] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:33 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:34.343063 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-06485d27-f467-46f0-a6cb-7ac081f84493 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:34.344202 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-06485d27-f467-46f0-a6cb-7ac081f84493 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:34.354553 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-06485d27-f467-46f0-a6cb-7ac081f84493 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:34.355356 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-06485d27-f467-46f0-a6cb-7ac081f84493 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:34.356140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-06485d27-f467-46f0-a6cb-7ac081f84493 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:34.357279 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-06485d27-f467-46f0-a6cb-7ac081f84493 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:34.358039 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-06485d27-f467-46f0-a6cb-7ac081f84493 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:34.358748 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-06485d27-f467-46f0-a6cb-7ac081f84493 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:34.513087 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-06485d27-f467-46f0-a6cb-7ac081f84493 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:34.521289 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-06485d27-f467-46f0-a6cb-7ac081f84493 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1465 microversion: 2.1 time: 0.184770 Oct 04 09:01:34.521861 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 475/1000] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:34 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1465 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:34.568477 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b5ce3be8-b8dd-492d-9ed3-487887e1afe8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:34.569001 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b5ce3be8-b8dd-492d-9ed3-487887e1afe8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:34.575606 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b5ce3be8-b8dd-492d-9ed3-487887e1afe8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:34.576200 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b5ce3be8-b8dd-492d-9ed3-487887e1afe8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:34.576700 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b5ce3be8-b8dd-492d-9ed3-487887e1afe8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:34.577456 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b5ce3be8-b8dd-492d-9ed3-487887e1afe8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:34.577987 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b5ce3be8-b8dd-492d-9ed3-487887e1afe8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:34.578469 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b5ce3be8-b8dd-492d-9ed3-487887e1afe8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:34.603870 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b5ce3be8-b8dd-492d-9ed3-487887e1afe8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Going to try to terminate instance {{(pid=142438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:01:34.673239 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:34.692883 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b5ce3be8-b8dd-492d-9ed3-487887e1afe8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 204 len: 0 microversion: 2.1 time: 0.128288 Oct 04 09:01:34.693484 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 526/1001] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:01:34 2022] DELETE /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:01:34.703052 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f7ecb456-f6d5-4a11-95c2-61cc10535296 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:34.704325 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f7ecb456-f6d5-4a11-95c2-61cc10535296 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:34.710856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f7ecb456-f6d5-4a11-95c2-61cc10535296 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:34.711336 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f7ecb456-f6d5-4a11-95c2-61cc10535296 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:34.711764 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f7ecb456-f6d5-4a11-95c2-61cc10535296 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:34.712668 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f7ecb456-f6d5-4a11-95c2-61cc10535296 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:34.713120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f7ecb456-f6d5-4a11-95c2-61cc10535296 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:34.713704 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f7ecb456-f6d5-4a11-95c2-61cc10535296 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:34.790073 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f97714a6-9b90-4d1d-9c38-478a24881883 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:34.790962 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f97714a6-9b90-4d1d-9c38-478a24881883 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:34.797600 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f97714a6-9b90-4d1d-9c38-478a24881883 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:34.798088 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f97714a6-9b90-4d1d-9c38-478a24881883 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:34.798518 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f97714a6-9b90-4d1d-9c38-478a24881883 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:34.799237 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f97714a6-9b90-4d1d-9c38-478a24881883 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:34.799688 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f97714a6-9b90-4d1d-9c38-478a24881883 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:34.800131 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f97714a6-9b90-4d1d-9c38-478a24881883 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:34.894431 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f7ecb456-f6d5-4a11-95c2-61cc10535296 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:34.903943 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f7ecb456-f6d5-4a11-95c2-61cc10535296 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1471 microversion: 2.1 time: 0.205899 Oct 04 09:01:34.904677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 476/1002] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:34 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:34.961817 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f97714a6-9b90-4d1d-9c38-478a24881883 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:34.970394 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f97714a6-9b90-4d1d-9c38-478a24881883 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:34.972053 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f97714a6-9b90-4d1d-9c38-478a24881883 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:34.973488 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f97714a6-9b90-4d1d-9c38-478a24881883 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.190800 Oct 04 09:01:34.974116 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 527/1003] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:34 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:35.928157 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-49b0112a-44bc-45e9-a09e-c2c7243c3759 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:35.928705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-49b0112a-44bc-45e9-a09e-c2c7243c3759 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:35.935432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-49b0112a-44bc-45e9-a09e-c2c7243c3759 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:35.935929 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-49b0112a-44bc-45e9-a09e-c2c7243c3759 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:35.936384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-49b0112a-44bc-45e9-a09e-c2c7243c3759 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:35.937082 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-49b0112a-44bc-45e9-a09e-c2c7243c3759 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:35.937544 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-49b0112a-44bc-45e9-a09e-c2c7243c3759 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:35.937973 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-49b0112a-44bc-45e9-a09e-c2c7243c3759 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:35.999200 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-3b966b93-844f-430c-bb9e-6bde26dfe4d0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:35.999845 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-3b966b93-844f-430c-bb9e-6bde26dfe4d0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:36.006400 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3b966b93-844f-430c-bb9e-6bde26dfe4d0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:36.006881 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3b966b93-844f-430c-bb9e-6bde26dfe4d0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:36.007294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3b966b93-844f-430c-bb9e-6bde26dfe4d0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:36.008261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3b966b93-844f-430c-bb9e-6bde26dfe4d0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:36.008721 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3b966b93-844f-430c-bb9e-6bde26dfe4d0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:36.009142 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3b966b93-844f-430c-bb9e-6bde26dfe4d0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:36.111327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-49b0112a-44bc-45e9-a09e-c2c7243c3759 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:36.120660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-49b0112a-44bc-45e9-a09e-c2c7243c3759 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1471 microversion: 2.1 time: 0.196628 Oct 04 09:01:36.121615 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 477/1004] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:35 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:36.159360 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3b966b93-844f-430c-bb9e-6bde26dfe4d0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:36.167757 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3b966b93-844f-430c-bb9e-6bde26dfe4d0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:36.169228 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3b966b93-844f-430c-bb9e-6bde26dfe4d0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:36.170391 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-3b966b93-844f-430c-bb9e-6bde26dfe4d0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.175221 Oct 04 09:01:36.170953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 528/1005] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:35 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 09:01:36.863019 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-6ac2314d-30d8-4770-a4d2-12cd78bd36c7 req-e8673134-466e-42b3-91e8-17715f949632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1061f9-f871-41c0-bb00-286c487e6ed7", "name": "network-vif-deleted", "tag": "7b676b49-5509-47b9-bc29-7fdd5e33fdd1"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:36.880916 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-6ac2314d-30d8-4770-a4d2-12cd78bd36c7 req-e8673134-466e-42b3-91e8-17715f949632 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:36.881405 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-6ac2314d-30d8-4770-a4d2-12cd78bd36c7 req-e8673134-466e-42b3-91e8-17715f949632 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:36.881888 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-6ac2314d-30d8-4770-a4d2-12cd78bd36c7 req-e8673134-466e-42b3-91e8-17715f949632 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:36.904623 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-6ac2314d-30d8-4770-a4d2-12cd78bd36c7 req-e8673134-466e-42b3-91e8-17715f949632 service nova] Creating event network-vif-deleted:7b676b49-5509-47b9-bc29-7fdd5e33fdd1 for instance 9f1061f9-f871-41c0-bb00-286c487e6ed7 on hv-cinder-84456 Oct 04 09:01:36.911433 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-6ac2314d-30d8-4770-a4d2-12cd78bd36c7 req-e8673134-466e-42b3-91e8-17715f949632 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052701 Oct 04 09:01:36.915341 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 478/1006] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:01:37.144810 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d9561752-3011-4add-927f-f412a14eaa5d tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:37.145638 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d9561752-3011-4add-927f-f412a14eaa5d tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:37.152588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9561752-3011-4add-927f-f412a14eaa5d tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:37.153395 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9561752-3011-4add-927f-f412a14eaa5d tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:37.154053 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9561752-3011-4add-927f-f412a14eaa5d tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:37.154971 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9561752-3011-4add-927f-f412a14eaa5d tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:37.155634 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9561752-3011-4add-927f-f412a14eaa5d tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:37.156289 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d9561752-3011-4add-927f-f412a14eaa5d tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:37.196952 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-232b44da-d3f0-44ea-96bb-7848bea69984 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:37.197651 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-232b44da-d3f0-44ea-96bb-7848bea69984 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:37.205331 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-232b44da-d3f0-44ea-96bb-7848bea69984 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:37.206413 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-232b44da-d3f0-44ea-96bb-7848bea69984 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:37.207023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-232b44da-d3f0-44ea-96bb-7848bea69984 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:37.207787 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-232b44da-d3f0-44ea-96bb-7848bea69984 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:37.208516 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-232b44da-d3f0-44ea-96bb-7848bea69984 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:37.208994 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-232b44da-d3f0-44ea-96bb-7848bea69984 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:37.229474 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d9561752-3011-4add-927f-f412a14eaa5d tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:37.237555 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d9561752-3011-4add-927f-f412a14eaa5d tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1300 microversion: 2.1 time: 0.096872 Oct 04 09:01:37.249092 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 529/1007] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:37 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:37.345180 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-232b44da-d3f0-44ea-96bb-7848bea69984 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:37.353809 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-232b44da-d3f0-44ea-96bb-7848bea69984 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:37.355241 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-232b44da-d3f0-44ea-96bb-7848bea69984 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:37.356456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-232b44da-d3f0-44ea-96bb-7848bea69984 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.164444 Oct 04 09:01:37.356977 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 479/1008] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:37 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 09:01:38.273795 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-90acf4f1-0f03-4dd4-8de9-84fd4ae5e2aa tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:38.275208 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-90acf4f1-0f03-4dd4-8de9-84fd4ae5e2aa tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:38.282224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90acf4f1-0f03-4dd4-8de9-84fd4ae5e2aa tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:38.283004 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90acf4f1-0f03-4dd4-8de9-84fd4ae5e2aa tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:38.283718 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90acf4f1-0f03-4dd4-8de9-84fd4ae5e2aa tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:38.284659 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90acf4f1-0f03-4dd4-8de9-84fd4ae5e2aa tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:38.285322 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90acf4f1-0f03-4dd4-8de9-84fd4ae5e2aa tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:38.285953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-90acf4f1-0f03-4dd4-8de9-84fd4ae5e2aa tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:38.351527 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-90acf4f1-0f03-4dd4-8de9-84fd4ae5e2aa tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:38.360756 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-90acf4f1-0f03-4dd4-8de9-84fd4ae5e2aa tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1300 microversion: 2.1 time: 0.091818 Oct 04 09:01:38.361557 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 530/1009] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:38 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:38.382921 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6a351d18-bda3-4d52-b856-7050bf829434 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:38.384227 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6a351d18-bda3-4d52-b856-7050bf829434 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:38.391449 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6a351d18-bda3-4d52-b856-7050bf829434 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:38.392266 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6a351d18-bda3-4d52-b856-7050bf829434 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:38.392938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6a351d18-bda3-4d52-b856-7050bf829434 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:38.393711 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6a351d18-bda3-4d52-b856-7050bf829434 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:38.394215 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6a351d18-bda3-4d52-b856-7050bf829434 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:38.394701 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6a351d18-bda3-4d52-b856-7050bf829434 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:38.537814 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6a351d18-bda3-4d52-b856-7050bf829434 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:38.546445 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6a351d18-bda3-4d52-b856-7050bf829434 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:38.547863 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6a351d18-bda3-4d52-b856-7050bf829434 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:38.549054 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6a351d18-bda3-4d52-b856-7050bf829434 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.170494 Oct 04 09:01:38.549602 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 480/1010] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:38 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:39.384893 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4bd88afc-54df-489d-baaf-f428f8324ca5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:39.385616 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4bd88afc-54df-489d-baaf-f428f8324ca5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:39.392956 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4bd88afc-54df-489d-baaf-f428f8324ca5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:39.393739 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4bd88afc-54df-489d-baaf-f428f8324ca5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:39.394515 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4bd88afc-54df-489d-baaf-f428f8324ca5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:39.395292 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4bd88afc-54df-489d-baaf-f428f8324ca5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:39.395820 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4bd88afc-54df-489d-baaf-f428f8324ca5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:39.396353 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4bd88afc-54df-489d-baaf-f428f8324ca5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:39.461531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4bd88afc-54df-489d-baaf-f428f8324ca5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:39.469377 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4bd88afc-54df-489d-baaf-f428f8324ca5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1300 microversion: 2.1 time: 0.088688 Oct 04 09:01:39.469945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 531/1011] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:39 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:39.578567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a4604032-3167-4f73-87d4-11bc3351ee15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:39.579612 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a4604032-3167-4f73-87d4-11bc3351ee15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:39.587953 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a4604032-3167-4f73-87d4-11bc3351ee15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:39.588470 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a4604032-3167-4f73-87d4-11bc3351ee15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:39.588911 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a4604032-3167-4f73-87d4-11bc3351ee15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:39.589802 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a4604032-3167-4f73-87d4-11bc3351ee15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:39.590324 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a4604032-3167-4f73-87d4-11bc3351ee15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:39.590691 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a4604032-3167-4f73-87d4-11bc3351ee15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:39.725656 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a4604032-3167-4f73-87d4-11bc3351ee15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:39.747009 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a4604032-3167-4f73-87d4-11bc3351ee15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:39.748595 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a4604032-3167-4f73-87d4-11bc3351ee15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:39.749818 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a4604032-3167-4f73-87d4-11bc3351ee15 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.177844 Oct 04 09:01:39.750579 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 481/1012] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:39 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:40.495278 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6e0e5c39-6b76-4dfb-8f64-fd4c67be66c8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:40.495924 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6e0e5c39-6b76-4dfb-8f64-fd4c67be66c8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:40.502979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e0e5c39-6b76-4dfb-8f64-fd4c67be66c8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:40.503466 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e0e5c39-6b76-4dfb-8f64-fd4c67be66c8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:40.503914 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e0e5c39-6b76-4dfb-8f64-fd4c67be66c8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:40.504603 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e0e5c39-6b76-4dfb-8f64-fd4c67be66c8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:40.505110 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e0e5c39-6b76-4dfb-8f64-fd4c67be66c8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:40.505536 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e0e5c39-6b76-4dfb-8f64-fd4c67be66c8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:40.574568 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6e0e5c39-6b76-4dfb-8f64-fd4c67be66c8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:40.585304 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6e0e5c39-6b76-4dfb-8f64-fd4c67be66c8 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1300 microversion: 2.1 time: 0.095524 Oct 04 09:01:40.590920 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 532/1013] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:40 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1300 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:40.776995 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-7c48e0e7-5234-46fe-acea-32413515bd2f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:40.778256 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-7c48e0e7-5234-46fe-acea-32413515bd2f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:40.785159 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7c48e0e7-5234-46fe-acea-32413515bd2f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:40.785898 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7c48e0e7-5234-46fe-acea-32413515bd2f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:40.786543 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7c48e0e7-5234-46fe-acea-32413515bd2f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:40.787438 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7c48e0e7-5234-46fe-acea-32413515bd2f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:40.788083 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7c48e0e7-5234-46fe-acea-32413515bd2f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:40.788668 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7c48e0e7-5234-46fe-acea-32413515bd2f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:40.933676 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7c48e0e7-5234-46fe-acea-32413515bd2f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:40.943740 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7c48e0e7-5234-46fe-acea-32413515bd2f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:40.946680 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7c48e0e7-5234-46fe-acea-32413515bd2f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:40.948200 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-7c48e0e7-5234-46fe-acea-32413515bd2f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.175973 Oct 04 09:01:40.949319 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 482/1014] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:40 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:41.609610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e78750da-e0cf-492e-a695-9f65e295ae3b tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:41.610263 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e78750da-e0cf-492e-a695-9f65e295ae3b tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:41.619577 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e78750da-e0cf-492e-a695-9f65e295ae3b tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:41.619577 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e78750da-e0cf-492e-a695-9f65e295ae3b tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:41.619577 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e78750da-e0cf-492e-a695-9f65e295ae3b tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:41.619577 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e78750da-e0cf-492e-a695-9f65e295ae3b tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:41.620045 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e78750da-e0cf-492e-a695-9f65e295ae3b tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:41.620383 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e78750da-e0cf-492e-a695-9f65e295ae3b tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:41.707016 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e78750da-e0cf-492e-a695-9f65e295ae3b tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:41.717857 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e78750da-e0cf-492e-a695-9f65e295ae3b tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1300 microversion: 2.1 time: 0.111910 Oct 04 09:01:41.718685 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 533/1015] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:41 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:41.974020 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5ab9e648-ffad-4fc2-88d8-bcbe0c321493 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:41.974649 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5ab9e648-ffad-4fc2-88d8-bcbe0c321493 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:41.983476 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ab9e648-ffad-4fc2-88d8-bcbe0c321493 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:41.984307 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ab9e648-ffad-4fc2-88d8-bcbe0c321493 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:41.985014 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ab9e648-ffad-4fc2-88d8-bcbe0c321493 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:41.986093 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ab9e648-ffad-4fc2-88d8-bcbe0c321493 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:41.986765 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ab9e648-ffad-4fc2-88d8-bcbe0c321493 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:41.987401 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ab9e648-ffad-4fc2-88d8-bcbe0c321493 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:42.167994 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5ab9e648-ffad-4fc2-88d8-bcbe0c321493 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:42.176109 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5ab9e648-ffad-4fc2-88d8-bcbe0c321493 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:42.177623 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5ab9e648-ffad-4fc2-88d8-bcbe0c321493 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:42.178776 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5ab9e648-ffad-4fc2-88d8-bcbe0c321493 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.208877 Oct 04 09:01:42.179342 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 483/1016] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:41 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:42.741736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c9b96b4f-d393-408c-b750-6ca0797c24c5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:42.742345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c9b96b4f-d393-408c-b750-6ca0797c24c5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:42.749576 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c9b96b4f-d393-408c-b750-6ca0797c24c5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:42.750103 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c9b96b4f-d393-408c-b750-6ca0797c24c5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:42.750539 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c9b96b4f-d393-408c-b750-6ca0797c24c5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:42.751251 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c9b96b4f-d393-408c-b750-6ca0797c24c5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:42.751727 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c9b96b4f-d393-408c-b750-6ca0797c24c5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:42.752192 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c9b96b4f-d393-408c-b750-6ca0797c24c5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:42.816257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c9b96b4f-d393-408c-b750-6ca0797c24c5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:42.824685 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c9b96b4f-d393-408c-b750-6ca0797c24c5 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1300 microversion: 2.1 time: 0.086954 Oct 04 09:01:42.825283 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 534/1017] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:42 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:43.208854 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1f9d9cbd-f9e1-4a28-8a38-cee6eb2f54ba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:43.210242 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1f9d9cbd-f9e1-4a28-8a38-cee6eb2f54ba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:43.217574 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1f9d9cbd-f9e1-4a28-8a38-cee6eb2f54ba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:43.218434 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1f9d9cbd-f9e1-4a28-8a38-cee6eb2f54ba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:43.219111 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1f9d9cbd-f9e1-4a28-8a38-cee6eb2f54ba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:43.220092 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1f9d9cbd-f9e1-4a28-8a38-cee6eb2f54ba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:43.220760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1f9d9cbd-f9e1-4a28-8a38-cee6eb2f54ba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:43.221398 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1f9d9cbd-f9e1-4a28-8a38-cee6eb2f54ba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:43.357725 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1f9d9cbd-f9e1-4a28-8a38-cee6eb2f54ba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:43.366234 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1f9d9cbd-f9e1-4a28-8a38-cee6eb2f54ba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:43.367598 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1f9d9cbd-f9e1-4a28-8a38-cee6eb2f54ba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:43.369143 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1f9d9cbd-f9e1-4a28-8a38-cee6eb2f54ba tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.164004 Oct 04 09:01:43.370355 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 484/1018] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:43 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:43.848682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-939d755a-ad09-4531-820b-013e95c16482 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:43.849497 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-939d755a-ad09-4531-820b-013e95c16482 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:43.856787 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-939d755a-ad09-4531-820b-013e95c16482 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:43.857370 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-939d755a-ad09-4531-820b-013e95c16482 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:43.857883 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-939d755a-ad09-4531-820b-013e95c16482 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:43.859945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-939d755a-ad09-4531-820b-013e95c16482 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:43.860496 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-939d755a-ad09-4531-820b-013e95c16482 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:43.861015 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-939d755a-ad09-4531-820b-013e95c16482 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:43.928375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-939d755a-ad09-4531-820b-013e95c16482 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:43.937629 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-939d755a-ad09-4531-820b-013e95c16482 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1300 microversion: 2.1 time: 0.092903 Oct 04 09:01:43.938991 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 535/1019] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:43 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:44.394913 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-30bd0bc6-d8db-4dea-97df-1341adbc8902 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:44.395507 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-30bd0bc6-d8db-4dea-97df-1341adbc8902 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:44.402459 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-30bd0bc6-d8db-4dea-97df-1341adbc8902 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:44.403325 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-30bd0bc6-d8db-4dea-97df-1341adbc8902 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:44.404614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-30bd0bc6-d8db-4dea-97df-1341adbc8902 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:44.405562 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-30bd0bc6-d8db-4dea-97df-1341adbc8902 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:44.406227 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-30bd0bc6-d8db-4dea-97df-1341adbc8902 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:44.407301 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-30bd0bc6-d8db-4dea-97df-1341adbc8902 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:44.552412 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-30bd0bc6-d8db-4dea-97df-1341adbc8902 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:44.560630 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-30bd0bc6-d8db-4dea-97df-1341adbc8902 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:44.562048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-30bd0bc6-d8db-4dea-97df-1341adbc8902 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:44.563644 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-30bd0bc6-d8db-4dea-97df-1341adbc8902 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.172512 Oct 04 09:01:44.564378 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 485/1020] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:44 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:44.961737 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f3f97de5-3aa3-4970-94d4-895619b7aec9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:44.962362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f3f97de5-3aa3-4970-94d4-895619b7aec9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:44.970603 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f3f97de5-3aa3-4970-94d4-895619b7aec9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:44.971092 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f3f97de5-3aa3-4970-94d4-895619b7aec9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:44.971531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f3f97de5-3aa3-4970-94d4-895619b7aec9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:44.972459 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f3f97de5-3aa3-4970-94d4-895619b7aec9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:44.972693 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f3f97de5-3aa3-4970-94d4-895619b7aec9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:44.973115 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f3f97de5-3aa3-4970-94d4-895619b7aec9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:45.040216 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f3f97de5-3aa3-4970-94d4-895619b7aec9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:45.047999 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f3f97de5-3aa3-4970-94d4-895619b7aec9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1300 microversion: 2.1 time: 0.090333 Oct 04 09:01:45.048565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 536/1021] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:44 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:45.723248 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f9977f96-0e67-477d-9125-765122fee695 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:45.724034 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f9977f96-0e67-477d-9125-765122fee695 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:45.730665 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9977f96-0e67-477d-9125-765122fee695 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:45.731157 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9977f96-0e67-477d-9125-765122fee695 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:45.731594 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9977f96-0e67-477d-9125-765122fee695 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:45.732335 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9977f96-0e67-477d-9125-765122fee695 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:45.732795 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9977f96-0e67-477d-9125-765122fee695 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:45.733218 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9977f96-0e67-477d-9125-765122fee695 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:45.880858 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f9977f96-0e67-477d-9125-765122fee695 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:45.883295 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:45.890721 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f9977f96-0e67-477d-9125-765122fee695 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:45.892313 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f9977f96-0e67-477d-9125-765122fee695 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:45.893488 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f9977f96-0e67-477d-9125-765122fee695 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.306528 Oct 04 09:01:45.894056 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 486/1022] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:45 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:46.071860 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1a54b440-bdae-4600-838d-785d16c043df tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:46.072521 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1a54b440-bdae-4600-838d-785d16c043df tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:46.079393 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1a54b440-bdae-4600-838d-785d16c043df tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:46.079900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1a54b440-bdae-4600-838d-785d16c043df tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:46.080343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1a54b440-bdae-4600-838d-785d16c043df tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:46.081041 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1a54b440-bdae-4600-838d-785d16c043df tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:46.081496 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1a54b440-bdae-4600-838d-785d16c043df tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:46.081925 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1a54b440-bdae-4600-838d-785d16c043df tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:46.146154 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1a54b440-bdae-4600-838d-785d16c043df tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:46.154260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1a54b440-bdae-4600-838d-785d16c043df tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1300 microversion: 2.1 time: 0.086513 Oct 04 09:01:46.154819 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 537/1023] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:46 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:46.920529 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-dfcf386e-5ce5-464b-890f-6a04e9df739d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:46.921284 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-dfcf386e-5ce5-464b-890f-6a04e9df739d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:46.929022 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dfcf386e-5ce5-464b-890f-6a04e9df739d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:46.929528 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dfcf386e-5ce5-464b-890f-6a04e9df739d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:46.939200 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dfcf386e-5ce5-464b-890f-6a04e9df739d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:46.940104 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dfcf386e-5ce5-464b-890f-6a04e9df739d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:46.940603 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dfcf386e-5ce5-464b-890f-6a04e9df739d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:46.941038 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dfcf386e-5ce5-464b-890f-6a04e9df739d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:47.081991 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dfcf386e-5ce5-464b-890f-6a04e9df739d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:47.091363 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dfcf386e-5ce5-464b-890f-6a04e9df739d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:47.092913 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dfcf386e-5ce5-464b-890f-6a04e9df739d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:47.094129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-dfcf386e-5ce5-464b-890f-6a04e9df739d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.178719 Oct 04 09:01:47.094691 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 487/1024] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:46 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:47.179135 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-35651a50-535d-43b5-9778-942d361b461a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:47.179913 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-35651a50-535d-43b5-9778-942d361b461a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:47.187420 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-35651a50-535d-43b5-9778-942d361b461a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:47.187967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-35651a50-535d-43b5-9778-942d361b461a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:47.188403 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-35651a50-535d-43b5-9778-942d361b461a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:47.189109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-35651a50-535d-43b5-9778-942d361b461a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:47.189554 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-35651a50-535d-43b5-9778-942d361b461a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:47.189972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-35651a50-535d-43b5-9778-942d361b461a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:47.208279 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:47.256717 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-35651a50-535d-43b5-9778-942d361b461a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:47.264761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-35651a50-535d-43b5-9778-942d361b461a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1300 microversion: 2.1 time: 0.090633 Oct 04 09:01:47.265330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 538/1025] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:47 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:48.124245 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4790241d-f638-4d32-9454-86a4c827ae48 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:48.125132 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4790241d-f638-4d32-9454-86a4c827ae48 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:48.135558 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4790241d-f638-4d32-9454-86a4c827ae48 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:48.136090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4790241d-f638-4d32-9454-86a4c827ae48 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:48.136530 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4790241d-f638-4d32-9454-86a4c827ae48 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:48.137232 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4790241d-f638-4d32-9454-86a4c827ae48 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:48.137687 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4790241d-f638-4d32-9454-86a4c827ae48 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:48.138119 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4790241d-f638-4d32-9454-86a4c827ae48 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:48.272835 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4790241d-f638-4d32-9454-86a4c827ae48 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:48.281379 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4790241d-f638-4d32-9454-86a4c827ae48 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:48.282854 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4790241d-f638-4d32-9454-86a4c827ae48 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:48.284050 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4790241d-f638-4d32-9454-86a4c827ae48 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.167581 Oct 04 09:01:48.284742 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 488/1026] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:48 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:48.287902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-02e7908d-89cc-42e0-b530-bade76cc9dbd tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:48.288522 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-02e7908d-89cc-42e0-b530-bade76cc9dbd tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:48.295103 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-02e7908d-89cc-42e0-b530-bade76cc9dbd tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:48.295577 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-02e7908d-89cc-42e0-b530-bade76cc9dbd tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:48.296041 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-02e7908d-89cc-42e0-b530-bade76cc9dbd tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:48.296711 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-02e7908d-89cc-42e0-b530-bade76cc9dbd tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:48.297157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-02e7908d-89cc-42e0-b530-bade76cc9dbd tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:48.297570 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-02e7908d-89cc-42e0-b530-bade76cc9dbd tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:48.361747 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-02e7908d-89cc-42e0-b530-bade76cc9dbd tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:48.370349 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-02e7908d-89cc-42e0-b530-bade76cc9dbd tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1300 microversion: 2.1 time: 0.086338 Oct 04 09:01:48.370907 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 539/1027] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:48 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:01:49.313748 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0a262a7b-93eb-4dea-83c5-4ff476f9deb7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:49.314758 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0a262a7b-93eb-4dea-83c5-4ff476f9deb7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:49.325520 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a262a7b-93eb-4dea-83c5-4ff476f9deb7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:49.326345 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a262a7b-93eb-4dea-83c5-4ff476f9deb7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:49.327058 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a262a7b-93eb-4dea-83c5-4ff476f9deb7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:49.328274 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a262a7b-93eb-4dea-83c5-4ff476f9deb7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:49.329112 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a262a7b-93eb-4dea-83c5-4ff476f9deb7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:49.329858 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0a262a7b-93eb-4dea-83c5-4ff476f9deb7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:49.393790 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ee406e75-5765-4d13-98b4-74591b3547ac tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:49.394398 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ee406e75-5765-4d13-98b4-74591b3547ac tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:49.401732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ee406e75-5765-4d13-98b4-74591b3547ac tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:49.402219 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ee406e75-5765-4d13-98b4-74591b3547ac tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:49.402646 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ee406e75-5765-4d13-98b4-74591b3547ac tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:49.403673 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ee406e75-5765-4d13-98b4-74591b3547ac tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:49.404170 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ee406e75-5765-4d13-98b4-74591b3547ac tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:49.404897 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ee406e75-5765-4d13-98b4-74591b3547ac tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:49.469392 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ee406e75-5765-4d13-98b4-74591b3547ac tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:49.477213 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ee406e75-5765-4d13-98b4-74591b3547ac tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1300 microversion: 2.1 time: 0.087407 Oct 04 09:01:49.477778 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 540/1028] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:49 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:49.490589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0a262a7b-93eb-4dea-83c5-4ff476f9deb7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:49.499862 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0a262a7b-93eb-4dea-83c5-4ff476f9deb7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:49.501352 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0a262a7b-93eb-4dea-83c5-4ff476f9deb7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:49.502530 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0a262a7b-93eb-4dea-83c5-4ff476f9deb7 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.195512 Oct 04 09:01:49.503089 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 489/1029] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:49 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:50.505390 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c69b19d2-799a-46dd-83bb-9d33d80fe2b9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:50.506352 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c69b19d2-799a-46dd-83bb-9d33d80fe2b9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:50.515143 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c69b19d2-799a-46dd-83bb-9d33d80fe2b9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:50.515628 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c69b19d2-799a-46dd-83bb-9d33d80fe2b9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:50.516105 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c69b19d2-799a-46dd-83bb-9d33d80fe2b9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:50.516799 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c69b19d2-799a-46dd-83bb-9d33d80fe2b9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:50.517251 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c69b19d2-799a-46dd-83bb-9d33d80fe2b9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:50.517648 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c69b19d2-799a-46dd-83bb-9d33d80fe2b9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:50.527877 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-cd222580-9ad5-4678-9259-03cbbfe45851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:50.528506 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-cd222580-9ad5-4678-9259-03cbbfe45851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:50.535223 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cd222580-9ad5-4678-9259-03cbbfe45851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:50.535704 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cd222580-9ad5-4678-9259-03cbbfe45851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:50.536178 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cd222580-9ad5-4678-9259-03cbbfe45851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:50.536848 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cd222580-9ad5-4678-9259-03cbbfe45851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:50.537294 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cd222580-9ad5-4678-9259-03cbbfe45851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:50.537708 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cd222580-9ad5-4678-9259-03cbbfe45851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:50.587872 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c69b19d2-799a-46dd-83bb-9d33d80fe2b9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:50.595934 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c69b19d2-799a-46dd-83bb-9d33d80fe2b9 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1300 microversion: 2.1 time: 0.097647 Oct 04 09:01:50.596512 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 541/1030] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:50 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:50.681413 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-cd222580-9ad5-4678-9259-03cbbfe45851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:50.689735 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-cd222580-9ad5-4678-9259-03cbbfe45851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:50.691166 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-cd222580-9ad5-4678-9259-03cbbfe45851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:50.692342 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-cd222580-9ad5-4678-9259-03cbbfe45851 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.168349 Oct 04 09:01:50.692901 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 490/1031] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:50 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:51.623667 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d085a85f-c88d-4843-a762-3d9f1d8a352c tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:51.624693 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d085a85f-c88d-4843-a762-3d9f1d8a352c tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:51.635635 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d085a85f-c88d-4843-a762-3d9f1d8a352c tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:51.636527 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d085a85f-c88d-4843-a762-3d9f1d8a352c tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:51.637245 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d085a85f-c88d-4843-a762-3d9f1d8a352c tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:51.638374 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d085a85f-c88d-4843-a762-3d9f1d8a352c tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:51.639125 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d085a85f-c88d-4843-a762-3d9f1d8a352c tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:51.639820 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d085a85f-c88d-4843-a762-3d9f1d8a352c tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:51.674310 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d085a85f-c88d-4843-a762-3d9f1d8a352c tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:51.674776 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d085a85f-c88d-4843-a762-3d9f1d8a352c tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:51.675235 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d085a85f-c88d-4843-a762-3d9f1d8a352c tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:51.675667 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-d085a85f-c88d-4843-a762-3d9f1d8a352c tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lazy-loading 'fault' on Instance uuid 9f1061f9-f871-41c0-bb00-286c487e6ed7 {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:01:51.720168 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-10ef2503-46ec-40e6-adea-5b12b74ed4e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:51.720818 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-10ef2503-46ec-40e6-adea-5b12b74ed4e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:51.724575 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d085a85f-c88d-4843-a762-3d9f1d8a352c tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:51.727816 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10ef2503-46ec-40e6-adea-5b12b74ed4e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:51.728583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10ef2503-46ec-40e6-adea-5b12b74ed4e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:51.729066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10ef2503-46ec-40e6-adea-5b12b74ed4e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:51.729702 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10ef2503-46ec-40e6-adea-5b12b74ed4e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:51.730155 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10ef2503-46ec-40e6-adea-5b12b74ed4e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:51.730573 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-10ef2503-46ec-40e6-adea-5b12b74ed4e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:51.733395 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d085a85f-c88d-4843-a762-3d9f1d8a352c tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1305 microversion: 2.1 time: 0.116759 Oct 04 09:01:51.733998 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 542/1032] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:51 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1305 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:51.857744 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-10ef2503-46ec-40e6-adea-5b12b74ed4e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:51.865980 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-10ef2503-46ec-40e6-adea-5b12b74ed4e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:51.867410 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-10ef2503-46ec-40e6-adea-5b12b74ed4e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:51.868642 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-10ef2503-46ec-40e6-adea-5b12b74ed4e9 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.152452 Oct 04 09:01:51.869545 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 491/1033] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:51 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:52.030972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b3c8f729-0a3c-48af-8d06-015ab57edb0a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1424633393"}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:52.031851 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b3c8f729-0a3c-48af-8d06-015ab57edb0a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:52.041551 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b3c8f729-0a3c-48af-8d06-015ab57edb0a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:52.042032 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b3c8f729-0a3c-48af-8d06-015ab57edb0a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:52.042461 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b3c8f729-0a3c-48af-8d06-015ab57edb0a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:52.043143 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b3c8f729-0a3c-48af-8d06-015ab57edb0a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:52.043586 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b3c8f729-0a3c-48af-8d06-015ab57edb0a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:52.044031 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b3c8f729-0a3c-48af-8d06-015ab57edb0a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:52.176414 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.network.security_group_api [None req-b3c8f729-0a3c-48af-8d06-015ab57edb0a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Removing security group 46f0e86a-2649-4bd2-bfa8-07274ad48d52 from port 7964acdb-66e8-472d-b77c-526ae4282bc9 Oct 04 09:01:52.484618 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b3c8f729-0a3c-48af-8d06-015ab57edb0a tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "POST /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/action" status: 202 len: 0 microversion: 2.1 time: 0.460352 Oct 04 09:01:52.485224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 543/1034] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Oct 4 09:01:52 2022] POST /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:01:52.495161 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-636e4894-7bd9-4830-8e71-941a4ddd6c2a req-7fa64231-1199-4f72-8a10-3078f73fd3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5d6881-b38b-43b8-91c1-84e3e1338d9f", "tag": "7964acdb-66e8-472d-b77c-526ae4282bc9"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:52.514274 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-636e4894-7bd9-4830-8e71-941a4ddd6c2a req-7fa64231-1199-4f72-8a10-3078f73fd3c4 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:52.515047 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-636e4894-7bd9-4830-8e71-941a4ddd6c2a req-7fa64231-1199-4f72-8a10-3078f73fd3c4 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:52.515645 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-636e4894-7bd9-4830-8e71-941a4ddd6c2a req-7fa64231-1199-4f72-8a10-3078f73fd3c4 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:52.527596 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-636e4894-7bd9-4830-8e71-941a4ddd6c2a req-7fa64231-1199-4f72-8a10-3078f73fd3c4 service nova] Creating event network-changed:7964acdb-66e8-472d-b77c-526ae4282bc9 for instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f on hv-cinder-84456 Oct 04 09:01:52.533206 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-636e4894-7bd9-4830-8e71-941a4ddd6c2a req-7fa64231-1199-4f72-8a10-3078f73fd3c4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042238 Oct 04 09:01:52.533954 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 492/1035] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:01:52.757571 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-40750d6a-b73e-42c0-92f6-afb91229714a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:52.759326 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-40750d6a-b73e-42c0-92f6-afb91229714a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:52.766149 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-40750d6a-b73e-42c0-92f6-afb91229714a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:52.766659 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-40750d6a-b73e-42c0-92f6-afb91229714a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:52.767167 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-40750d6a-b73e-42c0-92f6-afb91229714a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:52.767954 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-40750d6a-b73e-42c0-92f6-afb91229714a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:52.768722 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-40750d6a-b73e-42c0-92f6-afb91229714a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:52.769227 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-40750d6a-b73e-42c0-92f6-afb91229714a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:52.801897 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-40750d6a-b73e-42c0-92f6-afb91229714a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:52.802654 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-40750d6a-b73e-42c0-92f6-afb91229714a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:52.803146 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-40750d6a-b73e-42c0-92f6-afb91229714a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:52.803768 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-40750d6a-b73e-42c0-92f6-afb91229714a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lazy-loading 'fault' on Instance uuid 9f1061f9-f871-41c0-bb00-286c487e6ed7 {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:01:52.895693 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8af4e974-832d-4e88-a2a0-5a6a1961d5c5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:52.896442 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8af4e974-832d-4e88-a2a0-5a6a1961d5c5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:52.903285 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8af4e974-832d-4e88-a2a0-5a6a1961d5c5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:52.903778 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8af4e974-832d-4e88-a2a0-5a6a1961d5c5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:52.904252 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8af4e974-832d-4e88-a2a0-5a6a1961d5c5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:52.904960 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8af4e974-832d-4e88-a2a0-5a6a1961d5c5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:52.905418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8af4e974-832d-4e88-a2a0-5a6a1961d5c5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:52.905842 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8af4e974-832d-4e88-a2a0-5a6a1961d5c5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:53.121284 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-40750d6a-b73e-42c0-92f6-afb91229714a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:53.129379 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-40750d6a-b73e-42c0-92f6-afb91229714a tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1305 microversion: 2.1 time: 0.376341 Oct 04 09:01:53.129923 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 544/1036] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:52 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1305 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:53.251523 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8af4e974-832d-4e88-a2a0-5a6a1961d5c5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:53.260114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8af4e974-832d-4e88-a2a0-5a6a1961d5c5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:53.261538 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8af4e974-832d-4e88-a2a0-5a6a1961d5c5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:53.262747 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8af4e974-832d-4e88-a2a0-5a6a1961d5c5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.371850 Oct 04 09:01:53.263304 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 493/1037] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:52 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 09:01:53.850104 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4cd91524-5cf6-46b6-922c-b6852b857932 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:53.850608 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4cd91524-5cf6-46b6-922c-b6852b857932 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:53.857160 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4cd91524-5cf6-46b6-922c-b6852b857932 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:53.857647 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4cd91524-5cf6-46b6-922c-b6852b857932 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:53.858082 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4cd91524-5cf6-46b6-922c-b6852b857932 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:53.858773 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4cd91524-5cf6-46b6-922c-b6852b857932 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:53.859225 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4cd91524-5cf6-46b6-922c-b6852b857932 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:53.859645 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4cd91524-5cf6-46b6-922c-b6852b857932 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:53.941157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-4cd91524-5cf6-46b6-922c-b6852b857932 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lazy-loading 'services' on Instance uuid bd5d6881-b38b-43b8-91c1-84e3e1338d9f {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:01:54.018364 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4cd91524-5cf6-46b6-922c-b6852b857932 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/os-volume_attachments/79a42d2a-64bd-408e-90cd-82e58d9cc980" status: 202 len: 0 microversion: 2.1 time: 0.172071 Oct 04 09:01:54.019045 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 545/1038] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Oct 4 09:01:53 2022] DELETE /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/os-volume_attachments/79a42d2a-64bd-408e-90cd-82e58d9cc980 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:01:54.027448 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-dde35c24-4b9b-4046-802e-e9d742e5d843 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:54.029792 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-dde35c24-4b9b-4046-802e-e9d742e5d843 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:54.036186 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dde35c24-4b9b-4046-802e-e9d742e5d843 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:54.036641 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dde35c24-4b9b-4046-802e-e9d742e5d843 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:54.037077 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dde35c24-4b9b-4046-802e-e9d742e5d843 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:54.037798 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dde35c24-4b9b-4046-802e-e9d742e5d843 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:54.038250 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dde35c24-4b9b-4046-802e-e9d742e5d843 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:54.038670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dde35c24-4b9b-4046-802e-e9d742e5d843 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:54.067866 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-dde35c24-4b9b-4046-802e-e9d742e5d843 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044372 Oct 04 09:01:54.068453 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 494/1039] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:01:54 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:01:54.153394 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b19a0590-1ed8-4b65-9317-f979f87b12d3 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:54.154070 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b19a0590-1ed8-4b65-9317-f979f87b12d3 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:54.173754 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b19a0590-1ed8-4b65-9317-f979f87b12d3 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:54.174453 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b19a0590-1ed8-4b65-9317-f979f87b12d3 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:54.174959 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b19a0590-1ed8-4b65-9317-f979f87b12d3 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:54.175706 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b19a0590-1ed8-4b65-9317-f979f87b12d3 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:54.176243 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b19a0590-1ed8-4b65-9317-f979f87b12d3 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:54.176598 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b19a0590-1ed8-4b65-9317-f979f87b12d3 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:54.219690 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b19a0590-1ed8-4b65-9317-f979f87b12d3 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:54.220218 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b19a0590-1ed8-4b65-9317-f979f87b12d3 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:54.220648 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b19a0590-1ed8-4b65-9317-f979f87b12d3 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:54.221316 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-b19a0590-1ed8-4b65-9317-f979f87b12d3 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lazy-loading 'fault' on Instance uuid 9f1061f9-f871-41c0-bb00-286c487e6ed7 {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:01:54.275729 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b19a0590-1ed8-4b65-9317-f979f87b12d3 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d49791d656a4cbaaf30609253a0e565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cefdaaad09e451dbb9e5e735845a9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:54.288520 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5752a9e6-48df-4f65-8912-614711ebe788 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:54.289505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5752a9e6-48df-4f65-8912-614711ebe788 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:54.290243 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b19a0590-1ed8-4b65-9317-f979f87b12d3 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 200 len: 1305 microversion: 2.1 time: 0.141147 Oct 04 09:01:54.296675 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5752a9e6-48df-4f65-8912-614711ebe788 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:54.297451 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5752a9e6-48df-4f65-8912-614711ebe788 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:54.298144 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5752a9e6-48df-4f65-8912-614711ebe788 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:54.299062 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5752a9e6-48df-4f65-8912-614711ebe788 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:54.299719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5752a9e6-48df-4f65-8912-614711ebe788 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:54.300418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5752a9e6-48df-4f65-8912-614711ebe788 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:54.304976 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 546/1040] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:54 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 1305 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:54.442164 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5752a9e6-48df-4f65-8912-614711ebe788 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:54.451126 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5752a9e6-48df-4f65-8912-614711ebe788 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:54.452686 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5752a9e6-48df-4f65-8912-614711ebe788 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:54.454193 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5752a9e6-48df-4f65-8912-614711ebe788 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.170013 Oct 04 09:01:54.454763 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 495/1041] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:54 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:54.549887 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-c3ddafcf-6e8d-4c17-800d-ba604dbb887c req-de3c8673-a87f-4106-beac-d6acf5173ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5d6881-b38b-43b8-91c1-84e3e1338d9f", "tag": "7964acdb-66e8-472d-b77c-526ae4282bc9"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:54.559548 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-c3ddafcf-6e8d-4c17-800d-ba604dbb887c req-de3c8673-a87f-4106-beac-d6acf5173ccb service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:54.560044 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-c3ddafcf-6e8d-4c17-800d-ba604dbb887c req-de3c8673-a87f-4106-beac-d6acf5173ccb service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:54.560452 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-c3ddafcf-6e8d-4c17-800d-ba604dbb887c req-de3c8673-a87f-4106-beac-d6acf5173ccb service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:54.572421 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-c3ddafcf-6e8d-4c17-800d-ba604dbb887c req-de3c8673-a87f-4106-beac-d6acf5173ccb service nova] Creating event network-changed:7964acdb-66e8-472d-b77c-526ae4282bc9 for instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f on hv-cinder-84456 Oct 04 09:01:54.577574 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-c3ddafcf-6e8d-4c17-800d-ba604dbb887c req-de3c8673-a87f-4106-beac-d6acf5173ccb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031429 Oct 04 09:01:54.578501 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 547/1042] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:01:55.080460 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-48004737-ee71-42a9-be54-2ae93ccba35f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:55.082732 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-48004737-ee71-42a9-be54-2ae93ccba35f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:55.089486 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-48004737-ee71-42a9-be54-2ae93ccba35f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:55.090001 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-48004737-ee71-42a9-be54-2ae93ccba35f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:55.090429 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-48004737-ee71-42a9-be54-2ae93ccba35f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:55.091133 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-48004737-ee71-42a9-be54-2ae93ccba35f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:55.091587 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-48004737-ee71-42a9-be54-2ae93ccba35f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:55.092028 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-48004737-ee71-42a9-be54-2ae93ccba35f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:55.128834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-48004737-ee71-42a9-be54-2ae93ccba35f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052332 Oct 04 09:01:55.131983 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 496/1043] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:01:55 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:01:55.316497 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-03e26504-1dac-4ab3-b283-4c92f6b72546 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:55.317222 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-03e26504-1dac-4ab3-b283-4c92f6b72546 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] [instance: 9f1061f9-f871-41c0-bb00-286c487e6ed7] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:55.324099 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-03e26504-1dac-4ab3-b283-4c92f6b72546 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:55.324703 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-03e26504-1dac-4ab3-b283-4c92f6b72546 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:55.325160 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-03e26504-1dac-4ab3-b283-4c92f6b72546 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:55.325842 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-03e26504-1dac-4ab3-b283-4c92f6b72546 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:55.326426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-03e26504-1dac-4ab3-b283-4c92f6b72546 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:55.326871 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-03e26504-1dac-4ab3-b283-4c92f6b72546 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:55.340970 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-03e26504-1dac-4ab3-b283-4c92f6b72546 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] HTTP exception thrown: Instance 9f1061f9-f871-41c0-bb00-286c487e6ed7 could not be found. Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-03e26504-1dac-4ab3-b283-4c92f6b72546 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Request method failure captured: Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 HTTP/1.1 Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_Zexc9s1VGLD538JJvONWI0U6QvTPG7eLJSBwE7-yYbtRnxlVYlLRb6QRxVFmcshnFCCmR_7vft78YmOzWjlIgSlhe1yw7npD1D4Bj2dptzwicLrt-D3hHGTY6JXwXbhke6IhyeZ3yvcVqC3ipXp-b1a246vyRmD7czBOj7CQfScbE Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 4cefdaaad09e451dbb9e5e735845a9cc Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-VolumesNegativeTest-910165254 Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:01:55.342680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:01:55.344411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4cefdaaad09e451dbb9e5e735845a9cc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4cefdaaad09e451dbb9e5e735845a9cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4cefdaaad09e451dbb9e5e735845a9cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4cefdaaad09e451dbb9e5e735845a9cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:01:55.344411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-VolumesNegativeTest-910165254 Oct 04 09:01:55.344411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 4cefdaaad09e451dbb9e5e735845a9cc Oct 04 09:01:55.344411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-VolumesNegativeTest-910165254 Oct 04 09:01:55.344411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-VolumesNegativeTest-910165254-project Oct 04 09:01:55.344411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:01:55.344411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:01:55.344411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 9d49791d656a4cbaaf30609253a0e565 Oct 04 09:01:55.344411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-VolumesNegativeTest-910165254-project Oct 04 09:01:55.344411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:01:55.344411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance 9f1061f9-f871-41c0-bb00-286c487e6ed7 could not be found. Oct 04 09:01:55.344411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': '9f1061f9-f871-41c0-bb00-286c487e6ed7'} Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f1061f9-f871-41c0-bb00-286c487e6ed7 could not be found. Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:01:55.345371 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f1061f9-f871-41c0-bb00-286c487e6ed7 could not be found. Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f1061f9-f871-41c0-bb00-286c487e6ed7 could not be found. Oct 04 09:01:55.347020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:01:55.348473 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-03e26504-1dac-4ab3-b283-4c92f6b72546 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] Returning 404 to user: Instance 9f1061f9-f871-41c0-bb00-286c487e6ed7 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:01:55.348473 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-03e26504-1dac-4ab3-b283-4c92f6b72546 tempest-VolumesNegativeTest-910165254 tempest-VolumesNegativeTest-910165254-project] 10.222.0.44 "GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7" status: 404 len: 111 microversion: 2.1 time: 0.032470 Oct 04 09:01:55.348473 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 548/1044] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:55 2022] GET /compute/v2.1/servers/9f1061f9-f871-41c0-bb00-286c487e6ed7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:01:55.480707 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-cb215a39-30c5-416d-a2fd-4e9e0a073fef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:55.481327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-cb215a39-30c5-416d-a2fd-4e9e0a073fef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:55.490453 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cb215a39-30c5-416d-a2fd-4e9e0a073fef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:55.491855 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cb215a39-30c5-416d-a2fd-4e9e0a073fef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:55.493120 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cb215a39-30c5-416d-a2fd-4e9e0a073fef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:55.495017 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cb215a39-30c5-416d-a2fd-4e9e0a073fef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:55.495714 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cb215a39-30c5-416d-a2fd-4e9e0a073fef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:55.497229 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-cb215a39-30c5-416d-a2fd-4e9e0a073fef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:55.649333 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-6edc44fa-8c9b-42dd-9e2a-6da62bacdf85 req-a6463582-15df-44e9-b210-3e379bdbcfa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92654e2b-1d8a-4564-8a00-e659b6ae6ec9", "name": "network-vif-plugged", "status": "completed", "tag": "f2362281-c90c-4e3f-bb88-2c03bca5bd71"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:55.652559 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-cb215a39-30c5-416d-a2fd-4e9e0a073fef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:55.659759 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-6edc44fa-8c9b-42dd-9e2a-6da62bacdf85 req-a6463582-15df-44e9-b210-3e379bdbcfa6 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:55.660306 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-6edc44fa-8c9b-42dd-9e2a-6da62bacdf85 req-a6463582-15df-44e9-b210-3e379bdbcfa6 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:55.660909 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-6edc44fa-8c9b-42dd-9e2a-6da62bacdf85 req-a6463582-15df-44e9-b210-3e379bdbcfa6 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:55.662558 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-cb215a39-30c5-416d-a2fd-4e9e0a073fef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:55.664458 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-cb215a39-30c5-416d-a2fd-4e9e0a073fef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:55.665719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-cb215a39-30c5-416d-a2fd-4e9e0a073fef tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.189307 Oct 04 09:01:55.666616 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 497/1045] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:55 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:55.677909 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-6edc44fa-8c9b-42dd-9e2a-6da62bacdf85 req-a6463582-15df-44e9-b210-3e379bdbcfa6 service nova] Creating event network-vif-plugged:f2362281-c90c-4e3f-bb88-2c03bca5bd71 for instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 on hv-cinder-84456 Oct 04 09:01:55.700353 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-6edc44fa-8c9b-42dd-9e2a-6da62bacdf85 req-a6463582-15df-44e9-b210-3e379bdbcfa6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054347 Oct 04 09:01:55.701768 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 549/1046] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:01:56.140889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9ae24161-025f-4a76-983b-48c1c4699d4f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:56.143150 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9ae24161-025f-4a76-983b-48c1c4699d4f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:56.149896 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ae24161-025f-4a76-983b-48c1c4699d4f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:56.150399 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ae24161-025f-4a76-983b-48c1c4699d4f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:56.150830 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ae24161-025f-4a76-983b-48c1c4699d4f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:56.151503 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ae24161-025f-4a76-983b-48c1c4699d4f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:56.152011 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ae24161-025f-4a76-983b-48c1c4699d4f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:56.152434 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9ae24161-025f-4a76-983b-48c1c4699d4f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:56.198003 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9ae24161-025f-4a76-983b-48c1c4699d4f tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061004 Oct 04 09:01:56.198780 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 498/1047] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:01:56 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 09:01:56.210439 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0f46d5c2-6b14-4042-b0e8-9f2b47f14009 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:56.211027 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0f46d5c2-6b14-4042-b0e8-9f2b47f14009 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:56.220352 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0f46d5c2-6b14-4042-b0e8-9f2b47f14009 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:56.220948 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0f46d5c2-6b14-4042-b0e8-9f2b47f14009 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:56.221671 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0f46d5c2-6b14-4042-b0e8-9f2b47f14009 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:56.222614 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0f46d5c2-6b14-4042-b0e8-9f2b47f14009 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:56.223376 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0f46d5c2-6b14-4042-b0e8-9f2b47f14009 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:56.223835 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0f46d5c2-6b14-4042-b0e8-9f2b47f14009 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:56.314365 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-0f46d5c2-6b14-4042-b0e8-9f2b47f14009 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] HTTP exception thrown: Instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f is not attached to volume 79a42d2a-64bd-408e-90cd-82e58d9cc980 Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0f46d5c2-6b14-4042-b0e8-9f2b47f14009 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Request method failure captured: Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: DELETE /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/os-volume_attachments/79a42d2a-64bd-408e-90cd-82e58d9cc980 HTTP/1.1 Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_WrfYCeiRtpla6ArVsAfeT7TmBKMgsPEWVTwf20uF-biY8esHcmEnRwfOVyPb3XlSlaaD7htsK7hC3xDhO63GVhPRGHcM5jytL2z5P7OJ9gkb2_tfMR-ZY3ragEb2tP7v2ABQWdWujpW16eLr7_4wzFjuM3dqwnb4lVc7DXloAoBrk Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 62a1577879c64dc6aac3d5fd4d7ad637 Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-TestMinimumBasicScenario-481382354 Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:01:56.324507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:01:56.326387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_62a1577879c64dc6aac3d5fd4d7ad637", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/62a1577879c64dc6aac3d5fd4d7ad637"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/62a1577879c64dc6aac3d5fd4d7ad637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/62a1577879c64dc6aac3d5fd4d7ad637"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:01:56.326387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-TestMinimumBasicScenario-481382354 Oct 04 09:01:56.326387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 62a1577879c64dc6aac3d5fd4d7ad637 Oct 04 09:01:56.326387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-TestMinimumBasicScenario-481382354 Oct 04 09:01:56.326387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-TestMinimumBasicScenario-481382354-project Oct 04 09:01:56.326387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:01:56.326387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:01:56.326387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 3fb4f49a5be0475889369e13c3bc1481 Oct 04 09:01:56.326387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-TestMinimumBasicScenario-481382354-project Oct 04 09:01:56.326387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:01:56.326387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f is not attached to volume 79a42d2a-64bd-408e-90cd-82e58d9cc980 Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'server_id': 'bd5d6881-b38b-43b8-91c1-84e3e1338d9f', 'id': '79a42d2a-64bd-408e-90cd-82e58d9cc980'} Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 79a42d2a-64bd-408e-90cd-82e58d9cc980. Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:01:56.327157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:01:56.328404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:01:56.328404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 09:01:56.328404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 09:01:56.328404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f is not attached to volume 79a42d2a-64bd-408e-90cd-82e58d9cc980 Oct 04 09:01:56.328404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:01:56.328404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:01:56.328404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:01:56.328404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:01:56.328404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:01:56.328404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:01:56.328404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:01:56.328404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:01:56.328404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f is not attached to volume 79a42d2a-64bd-408e-90cd-82e58d9cc980 Oct 04 09:01:56.328404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:01:56.330695 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0f46d5c2-6b14-4042-b0e8-9f2b47f14009 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Returning 404 to user: Instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f is not attached to volume 79a42d2a-64bd-408e-90cd-82e58d9cc980 {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:01:56.332257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0f46d5c2-6b14-4042-b0e8-9f2b47f14009 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/os-volume_attachments/79a42d2a-64bd-408e-90cd-82e58d9cc980" status: 404 len: 154 microversion: 2.1 time: 0.126455 Oct 04 09:01:56.333045 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 550/1048] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Oct 4 09:01:56 2022] DELETE /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f/os-volume_attachments/79a42d2a-64bd-408e-90cd-82e58d9cc980 => generated 154 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:01:56.691844 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-42556215-9ef6-4c8a-8177-3974ccb1a0e4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:56.692770 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-42556215-9ef6-4c8a-8177-3974ccb1a0e4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:56.699285 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-42556215-9ef6-4c8a-8177-3974ccb1a0e4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:56.700060 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-42556215-9ef6-4c8a-8177-3974ccb1a0e4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:56.700316 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-42556215-9ef6-4c8a-8177-3974ccb1a0e4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:56.700994 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-42556215-9ef6-4c8a-8177-3974ccb1a0e4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:56.701436 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-42556215-9ef6-4c8a-8177-3974ccb1a0e4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:56.701850 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-42556215-9ef6-4c8a-8177-3974ccb1a0e4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:56.840718 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-42556215-9ef6-4c8a-8177-3974ccb1a0e4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:56.848875 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-42556215-9ef6-4c8a-8177-3974ccb1a0e4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:56.851210 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-42556215-9ef6-4c8a-8177-3974ccb1a0e4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:56.853481 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-42556215-9ef6-4c8a-8177-3974ccb1a0e4 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.165348 Oct 04 09:01:56.854148 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 499/1049] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:56 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:57.513863 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6f4788b2-41fc-4993-8ce8-151b6c7e7403 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:57.515084 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6f4788b2-41fc-4993-8ce8-151b6c7e7403 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:57.520943 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6f4788b2-41fc-4993-8ce8-151b6c7e7403 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:57.521423 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6f4788b2-41fc-4993-8ce8-151b6c7e7403 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:57.521845 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6f4788b2-41fc-4993-8ce8-151b6c7e7403 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:57.525966 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6f4788b2-41fc-4993-8ce8-151b6c7e7403 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:57.525966 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6f4788b2-41fc-4993-8ce8-151b6c7e7403 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:57.525966 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6f4788b2-41fc-4993-8ce8-151b6c7e7403 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:57.550419 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6f4788b2-41fc-4993-8ce8-151b6c7e7403 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Going to try to terminate instance {{(pid=142438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:01:57.626176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6f4788b2-41fc-4993-8ce8-151b6c7e7403 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 204 len: 0 microversion: 2.1 time: 0.118503 Oct 04 09:01:57.627077 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 551/1050] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:01:57 2022] DELETE /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:01:57.635453 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b4e54c68-a88a-4fae-b845-01bd8c0735e4 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:57.636448 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b4e54c68-a88a-4fae-b845-01bd8c0735e4 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:57.645147 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b4e54c68-a88a-4fae-b845-01bd8c0735e4 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:57.645626 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b4e54c68-a88a-4fae-b845-01bd8c0735e4 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:57.646433 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b4e54c68-a88a-4fae-b845-01bd8c0735e4 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:57.647263 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b4e54c68-a88a-4fae-b845-01bd8c0735e4 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:57.647719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b4e54c68-a88a-4fae-b845-01bd8c0735e4 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:57.648313 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b4e54c68-a88a-4fae-b845-01bd8c0735e4 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:57.783612 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b4e54c68-a88a-4fae-b845-01bd8c0735e4 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:57.791681 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b4e54c68-a88a-4fae-b845-01bd8c0735e4 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1555 microversion: 2.1 time: 0.160286 Oct 04 09:01:57.792422 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 500/1051] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:57 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:57.884202 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b978fa0a-e74a-4c83-9ed1-973959a65f95 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:57.884202 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b978fa0a-e74a-4c83-9ed1-973959a65f95 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:57.888665 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b978fa0a-e74a-4c83-9ed1-973959a65f95 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:57.889133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b978fa0a-e74a-4c83-9ed1-973959a65f95 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:57.889566 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b978fa0a-e74a-4c83-9ed1-973959a65f95 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:57.890246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b978fa0a-e74a-4c83-9ed1-973959a65f95 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:57.890739 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b978fa0a-e74a-4c83-9ed1-973959a65f95 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:57.891093 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b978fa0a-e74a-4c83-9ed1-973959a65f95 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:58.023268 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b978fa0a-e74a-4c83-9ed1-973959a65f95 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:58.032308 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b978fa0a-e74a-4c83-9ed1-973959a65f95 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:58.033858 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b978fa0a-e74a-4c83-9ed1-973959a65f95 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:58.035054 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b978fa0a-e74a-4c83-9ed1-973959a65f95 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.157472 Oct 04 09:01:58.035602 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 552/1052] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:57 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:01:58.816983 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-194a4254-f6ff-407c-876a-120a51bc61b9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:58.817622 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-194a4254-f6ff-407c-876a-120a51bc61b9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:58.826176 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-194a4254-f6ff-407c-876a-120a51bc61b9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:58.826683 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-194a4254-f6ff-407c-876a-120a51bc61b9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:58.829227 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-194a4254-f6ff-407c-876a-120a51bc61b9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:58.830061 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-194a4254-f6ff-407c-876a-120a51bc61b9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:58.830855 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-194a4254-f6ff-407c-876a-120a51bc61b9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:58.831562 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-194a4254-f6ff-407c-876a-120a51bc61b9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:58.975290 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-194a4254-f6ff-407c-876a-120a51bc61b9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:58.987239 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-194a4254-f6ff-407c-876a-120a51bc61b9 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1555 microversion: 2.1 time: 0.174209 Oct 04 09:01:58.987935 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 501/1053] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:58 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:59.065692 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-cb29a8a3-1bc2-49e6-9324-cab36dd6da46 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:59.066579 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cb29a8a3-1bc2-49e6-9324-cab36dd6da46 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:59.076389 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb29a8a3-1bc2-49e6-9324-cab36dd6da46 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:59.076965 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb29a8a3-1bc2-49e6-9324-cab36dd6da46 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:59.077631 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb29a8a3-1bc2-49e6-9324-cab36dd6da46 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:59.080750 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb29a8a3-1bc2-49e6-9324-cab36dd6da46 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:59.080750 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb29a8a3-1bc2-49e6-9324-cab36dd6da46 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:59.080750 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cb29a8a3-1bc2-49e6-9324-cab36dd6da46 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:59.235707 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cb29a8a3-1bc2-49e6-9324-cab36dd6da46 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:59.244569 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cb29a8a3-1bc2-49e6-9324-cab36dd6da46 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:59.246009 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-cb29a8a3-1bc2-49e6-9324-cab36dd6da46 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:59.247283 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-cb29a8a3-1bc2-49e6-9324-cab36dd6da46 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1729 microversion: 2.20 time: 0.186773 Oct 04 09:01:59.247843 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 553/1054] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:01:59 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:02:00.015789 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-7d3ca9a1-3429-4e6d-ae31-6752e15a33ab tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:00.016503 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-7d3ca9a1-3429-4e6d-ae31-6752e15a33ab tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:00.024379 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7d3ca9a1-3429-4e6d-ae31-6752e15a33ab tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:00.025520 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7d3ca9a1-3429-4e6d-ae31-6752e15a33ab tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:00.025930 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7d3ca9a1-3429-4e6d-ae31-6752e15a33ab tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:00.026690 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7d3ca9a1-3429-4e6d-ae31-6752e15a33ab tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:00.027143 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7d3ca9a1-3429-4e6d-ae31-6752e15a33ab tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:00.027562 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7d3ca9a1-3429-4e6d-ae31-6752e15a33ab tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:00.177411 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7d3ca9a1-3429-4e6d-ae31-6752e15a33ab tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:00.196179 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-7d3ca9a1-3429-4e6d-ae31-6752e15a33ab tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1555 microversion: 2.1 time: 0.184929 Oct 04 09:02:00.197745 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 502/1055] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:00 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:00.272284 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-3bee1701-ec64-436b-a2b7-e62a2bb5ef99 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:00.272867 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-3bee1701-ec64-436b-a2b7-e62a2bb5ef99 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:00.279398 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3bee1701-ec64-436b-a2b7-e62a2bb5ef99 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:00.279904 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3bee1701-ec64-436b-a2b7-e62a2bb5ef99 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:00.280353 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3bee1701-ec64-436b-a2b7-e62a2bb5ef99 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:00.281131 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3bee1701-ec64-436b-a2b7-e62a2bb5ef99 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:00.281614 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3bee1701-ec64-436b-a2b7-e62a2bb5ef99 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:00.282036 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-3bee1701-ec64-436b-a2b7-e62a2bb5ef99 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:00.286174 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:00.418512 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3bee1701-ec64-436b-a2b7-e62a2bb5ef99 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:00.426785 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3bee1701-ec64-436b-a2b7-e62a2bb5ef99 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:00.428250 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-3bee1701-ec64-436b-a2b7-e62a2bb5ef99 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:00.429425 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-3bee1701-ec64-436b-a2b7-e62a2bb5ef99 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1716 microversion: 2.20 time: 0.161207 Oct 04 09:02:00.430022 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 554/1056] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:02:00 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 09:02:00.652403 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-38131dd7-9e70-4596-9ee8-48f422e10f35 req-c1e1c649-31a9-4440-86cb-3d25f867b06f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5d6881-b38b-43b8-91c1-84e3e1338d9f", "name": "network-vif-deleted", "tag": "7964acdb-66e8-472d-b77c-526ae4282bc9"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:02:00.662010 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-38131dd7-9e70-4596-9ee8-48f422e10f35 req-c1e1c649-31a9-4440-86cb-3d25f867b06f service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:00.662421 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-38131dd7-9e70-4596-9ee8-48f422e10f35 req-c1e1c649-31a9-4440-86cb-3d25f867b06f service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:00.662847 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-38131dd7-9e70-4596-9ee8-48f422e10f35 req-c1e1c649-31a9-4440-86cb-3d25f867b06f service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:00.674050 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-38131dd7-9e70-4596-9ee8-48f422e10f35 req-c1e1c649-31a9-4440-86cb-3d25f867b06f service nova] Creating event network-vif-deleted:7964acdb-66e8-472d-b77c-526ae4282bc9 for instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f on hv-cinder-84456 Oct 04 09:02:00.679373 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-38131dd7-9e70-4596-9ee8-48f422e10f35 req-c1e1c649-31a9-4440-86cb-3d25f867b06f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030931 Oct 04 09:02:00.680059 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 503/1057] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:01.220610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5b0542fe-48d0-4425-8cbf-4c53ecf791d1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:01.221259 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5b0542fe-48d0-4425-8cbf-4c53ecf791d1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:01.227234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5b0542fe-48d0-4425-8cbf-4c53ecf791d1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:01.227722 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5b0542fe-48d0-4425-8cbf-4c53ecf791d1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:01.228191 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5b0542fe-48d0-4425-8cbf-4c53ecf791d1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:01.228881 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5b0542fe-48d0-4425-8cbf-4c53ecf791d1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:01.229361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5b0542fe-48d0-4425-8cbf-4c53ecf791d1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:01.229778 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5b0542fe-48d0-4425-8cbf-4c53ecf791d1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:01.262235 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5b0542fe-48d0-4425-8cbf-4c53ecf791d1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:01.262704 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5b0542fe-48d0-4425-8cbf-4c53ecf791d1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:01.263137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5b0542fe-48d0-4425-8cbf-4c53ecf791d1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:01.263582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-5b0542fe-48d0-4425-8cbf-4c53ecf791d1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lazy-loading 'fault' on Instance uuid bd5d6881-b38b-43b8-91c1-84e3e1338d9f {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:02:01.306728 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5b0542fe-48d0-4425-8cbf-4c53ecf791d1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb4f49a5be0475889369e13c3bc1481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a1577879c64dc6aac3d5fd4d7ad637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:01.314840 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5b0542fe-48d0-4425-8cbf-4c53ecf791d1 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 200 len: 1348 microversion: 2.1 time: 0.098124 Oct 04 09:02:01.315444 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 555/1058] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:01 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:02.344537 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ed4397b2-ca8d-4a07-b233-330acec62d39 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:02.345701 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ed4397b2-ca8d-4a07-b233-330acec62d39 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] [instance: bd5d6881-b38b-43b8-91c1-84e3e1338d9f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:02.356187 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ed4397b2-ca8d-4a07-b233-330acec62d39 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:02.356982 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ed4397b2-ca8d-4a07-b233-330acec62d39 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:02.357677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ed4397b2-ca8d-4a07-b233-330acec62d39 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:02.358866 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ed4397b2-ca8d-4a07-b233-330acec62d39 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:02.359740 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ed4397b2-ca8d-4a07-b233-330acec62d39 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:02.360215 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ed4397b2-ca8d-4a07-b233-330acec62d39 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:02.376144 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-ed4397b2-ca8d-4a07-b233-330acec62d39 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] HTTP exception thrown: Instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f could not be found. Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ed4397b2-ca8d-4a07-b233-330acec62d39 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Request method failure captured: Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f HTTP/1.1 Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_WrfYCeiRtpla6ArVsAfeT7TmBKMgsPEWVTwf20uF-biY8esHcmEnRwfOVyPb3XlSlaaD7htsK7hC3xDhO63GVhPRGHcM5jytL2z5P7OJ9gkb2_tfMR-ZY3ragEb2tP7v2ABQWdWujpW16eLr7_4wzFjuM3dqwnb4lVc7DXloAoBrk Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 62a1577879c64dc6aac3d5fd4d7ad637 Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-TestMinimumBasicScenario-481382354 Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:02:02.377805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:02:02.379387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_62a1577879c64dc6aac3d5fd4d7ad637", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/62a1577879c64dc6aac3d5fd4d7ad637"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/62a1577879c64dc6aac3d5fd4d7ad637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/62a1577879c64dc6aac3d5fd4d7ad637"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:02:02.379387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-TestMinimumBasicScenario-481382354 Oct 04 09:02:02.379387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 62a1577879c64dc6aac3d5fd4d7ad637 Oct 04 09:02:02.379387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-TestMinimumBasicScenario-481382354 Oct 04 09:02:02.379387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-TestMinimumBasicScenario-481382354-project Oct 04 09:02:02.379387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:02:02.379387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:02:02.379387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 3fb4f49a5be0475889369e13c3bc1481 Oct 04 09:02:02.379387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-TestMinimumBasicScenario-481382354-project Oct 04 09:02:02.379387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:02:02.379387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f could not be found. Oct 04 09:02:02.379387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': 'bd5d6881-b38b-43b8-91c1-84e3e1338d9f'} Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f could not be found. Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:02:02.380381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f could not be found. Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f could not be found. Oct 04 09:02:02.381905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:02.383230 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ed4397b2-ca8d-4a07-b233-330acec62d39 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Returning 404 to user: Instance bd5d6881-b38b-43b8-91c1-84e3e1338d9f could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:02:02.383230 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ed4397b2-ca8d-4a07-b233-330acec62d39 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f" status: 404 len: 111 microversion: 2.1 time: 0.042934 Oct 04 09:02:02.383230 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 504/1059] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:02 2022] GET /compute/v2.1/servers/bd5d6881-b38b-43b8-91c1-84e3e1338d9f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:02:02.389220 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-67e26c79-2359-4e87-844f-a9e3b3dee415 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] Calling method '.version_select at 0x7ff92e3c4c10>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:02.412500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-67e26c79-2359-4e87-844f-a9e3b3dee415 tempest-TestMinimumBasicScenario-481382354 tempest-TestMinimumBasicScenario-481382354-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-354667437" status: 202 len: 0 microversion: 2.1 time: 0.027031 Oct 04 09:02:02.413090 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 556/1060] 10.222.0.44 () {58 vars in 1269 bytes} [Tue Oct 4 09:02:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-354667437 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:02:22.155543 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2e866f9a-874a-4ab4-b918-8c43f99e5324 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:22.156228 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2e866f9a-874a-4ab4-b918-8c43f99e5324 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:22.158919 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=61 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:22.159614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=97 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:22.169550 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2e866f9a-874a-4ab4-b918-8c43f99e5324 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:22.170093 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2e866f9a-874a-4ab4-b918-8c43f99e5324 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:22.170539 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2e866f9a-874a-4ab4-b918-8c43f99e5324 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:22.171242 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2e866f9a-874a-4ab4-b918-8c43f99e5324 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:22.171696 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2e866f9a-874a-4ab4-b918-8c43f99e5324 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:22.172150 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2e866f9a-874a-4ab4-b918-8c43f99e5324 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:22.196763 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2e866f9a-874a-4ab4-b918-8c43f99e5324 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/ips" status: 200 len: 146 microversion: 2.1 time: 0.045263 Oct 04 09:02:22.197453 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 505/1061] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Oct 4 09:02:22 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/ips => generated 146 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:23.549670 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=12 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:23.550517 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:23.555301 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-05139a7d-8af0-4443-acd9-a7f71c3dc026 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f00cea1f-6124-4c99-9a94-a95e5f7738d2"}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:02:23.557780 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-05139a7d-8af0-4443-acd9-a7f71c3dc026 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:23.566215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-05139a7d-8af0-4443-acd9-a7f71c3dc026 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:23.566761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-05139a7d-8af0-4443-acd9-a7f71c3dc026 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:23.567195 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-05139a7d-8af0-4443-acd9-a7f71c3dc026 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:23.567906 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-05139a7d-8af0-4443-acd9-a7f71c3dc026 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:23.568360 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-05139a7d-8af0-4443-acd9-a7f71c3dc026 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:23.568785 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-05139a7d-8af0-4443-acd9-a7f71c3dc026 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:23.856295 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-05139a7d-8af0-4443-acd9-a7f71c3dc026 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "POST /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308022 Oct 04 09:02:23.856937 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 557/1062] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Oct 4 09:02:23 2022] POST /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:32.535830 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-76b166e8-1060-472f-9cc3-c75a0ee5b0e5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:32.538088 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-76b166e8-1060-472f-9cc3-c75a0ee5b0e5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:32.540750 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:32.541394 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=4 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:32.546971 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76b166e8-1060-472f-9cc3-c75a0ee5b0e5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:32.547444 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76b166e8-1060-472f-9cc3-c75a0ee5b0e5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:32.547926 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76b166e8-1060-472f-9cc3-c75a0ee5b0e5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:32.548613 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76b166e8-1060-472f-9cc3-c75a0ee5b0e5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:32.549060 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76b166e8-1060-472f-9cc3-c75a0ee5b0e5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:32.549474 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-76b166e8-1060-472f-9cc3-c75a0ee5b0e5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:32.579033 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-76b166e8-1060-472f-9cc3-c75a0ee5b0e5 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047154 Oct 04 09:02:32.579567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 506/1063] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:02:32 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:32.592996 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-74c3c0ed-675f-402b-91da-21dbeba244e6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:32.593568 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-74c3c0ed-675f-402b-91da-21dbeba244e6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:32.599831 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-74c3c0ed-675f-402b-91da-21dbeba244e6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:32.600348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-74c3c0ed-675f-402b-91da-21dbeba244e6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:32.600777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-74c3c0ed-675f-402b-91da-21dbeba244e6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:32.601457 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-74c3c0ed-675f-402b-91da-21dbeba244e6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:32.601904 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-74c3c0ed-675f-402b-91da-21dbeba244e6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:32.602325 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-74c3c0ed-675f-402b-91da-21dbeba244e6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:32.632362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-74c3c0ed-675f-402b-91da-21dbeba244e6 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments/f00cea1f-6124-4c99-9a94-a95e5f7738d2" status: 200 len: 194 microversion: 2.1 time: 0.044234 Oct 04 09:02:32.633014 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 558/1064] 10.222.0.44 () {58 vars in 1413 bytes} [Tue Oct 4 09:02:32 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments/f00cea1f-6124-4c99-9a94-a95e5f7738d2 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:35.058049 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-63bf48ce-cd58-45ef-947c-54213facc6c2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99e36528-8c95-48fe-8b98-fa9bac40f211"}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:02:35.060531 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-63bf48ce-cd58-45ef-947c-54213facc6c2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:35.067237 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63bf48ce-cd58-45ef-947c-54213facc6c2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:35.067716 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63bf48ce-cd58-45ef-947c-54213facc6c2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:35.068174 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63bf48ce-cd58-45ef-947c-54213facc6c2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:35.068856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63bf48ce-cd58-45ef-947c-54213facc6c2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:35.069303 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63bf48ce-cd58-45ef-947c-54213facc6c2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:35.069723 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63bf48ce-cd58-45ef-947c-54213facc6c2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:35.359351 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-63bf48ce-cd58-45ef-947c-54213facc6c2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "POST /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305865 Oct 04 09:02:35.359992 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 507/1065] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Oct 4 09:02:35 2022] POST /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:41.136955 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1340548749", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2035428488", "security_groups": [{"name": "tempest-secgroup-smoke-4569898"}], "block_device_mapping_v2": [{"uuid": "688628cc-ecb8-4404-a06a-513f12044c16", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a2b42168-a300-492f-b1dd-1ff13847d44a"}]}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:02:41.264804 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.network.neutron [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] validate_networks() for [('a2b42168-a300-492f-b1dd-1ff13847d44a', None, None, None, None, None)] {{(pid=142438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:02:41.922284 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Flavor limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:02:41.922915 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Image limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:02:41.923671 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Flavor pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:02:41.924340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Image pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:02:41.924982 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:02:41.937252 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:41.937739 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:41.938175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:41.938901 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:41.939355 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:41.939776 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:41.956819 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Getting quotas for project 881a40342cb84608b961e6b32dceadb4. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:02:41.961122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Getting quotas for user d8d329978baf425e954b9965ae0cb652 and project 881a40342cb84608b961e6b32dceadb4. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:02:42.019445 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Going to run 1 instances... {{(pid=142438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:02:42.021641 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='688628cc-ecb8-4404-a06a-513f12044c16',volume_size=None,volume_type=None)] {{(pid=142438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:02:42.160032 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-41e8ed3c-a112-4495-a9f2-acb371a70bb2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.027024 Oct 04 09:02:42.160696 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 559/1066] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 09:02:41 2022] POST /compute/v2.1/servers => generated 403 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 09:02:42.173062 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-26546c0d-0694-4408-ba19-6f57b32f194f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:42.173831 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-26546c0d-0694-4408-ba19-6f57b32f194f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:42.227640 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-26546c0d-0694-4408-ba19-6f57b32f194f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:42.234561 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-26546c0d-0694-4408-ba19-6f57b32f194f tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1095 microversion: 2.1 time: 0.065895 Oct 04 09:02:42.235126 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 508/1067] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:42 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:42.968378 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9bbc636b-61c1-4299-8e15-9b223967b792 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:42.970684 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9bbc636b-61c1-4299-8e15-9b223967b792 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:42.977045 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9bbc636b-61c1-4299-8e15-9b223967b792 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:42.977565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9bbc636b-61c1-4299-8e15-9b223967b792 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:42.977973 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9bbc636b-61c1-4299-8e15-9b223967b792 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:42.978930 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9bbc636b-61c1-4299-8e15-9b223967b792 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:42.979390 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9bbc636b-61c1-4299-8e15-9b223967b792 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:42.979815 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9bbc636b-61c1-4299-8e15-9b223967b792 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:43.011432 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-9bbc636b-61c1-4299-8e15-9b223967b792 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047610 Oct 04 09:02:43.011986 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 560/1068] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:02:42 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:43.163737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-714493b4-3d7b-41fc-ba4e-8fcea0b1793c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:43.164479 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-714493b4-3d7b-41fc-ba4e-8fcea0b1793c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:43.172949 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-714493b4-3d7b-41fc-ba4e-8fcea0b1793c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:43.173426 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-714493b4-3d7b-41fc-ba4e-8fcea0b1793c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:43.174016 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-714493b4-3d7b-41fc-ba4e-8fcea0b1793c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:43.174526 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-714493b4-3d7b-41fc-ba4e-8fcea0b1793c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:43.174977 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-714493b4-3d7b-41fc-ba4e-8fcea0b1793c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:43.175396 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-714493b4-3d7b-41fc-ba4e-8fcea0b1793c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:43.204227 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-714493b4-3d7b-41fc-ba4e-8fcea0b1793c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments/f00cea1f-6124-4c99-9a94-a95e5f7738d2" status: 200 len: 194 microversion: 2.1 time: 0.047282 Oct 04 09:02:43.204804 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 509/1069] 10.222.0.44 () {58 vars in 1413 bytes} [Tue Oct 4 09:02:43 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments/f00cea1f-6124-4c99-9a94-a95e5f7738d2 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:43.215622 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-85618b41-f512-4d74-9605-7bb090b3cc3e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:43.216150 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-85618b41-f512-4d74-9605-7bb090b3cc3e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:43.222077 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-85618b41-f512-4d74-9605-7bb090b3cc3e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:43.222552 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-85618b41-f512-4d74-9605-7bb090b3cc3e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:43.222984 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-85618b41-f512-4d74-9605-7bb090b3cc3e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:43.223663 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-85618b41-f512-4d74-9605-7bb090b3cc3e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:43.224142 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-85618b41-f512-4d74-9605-7bb090b3cc3e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:43.224549 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-85618b41-f512-4d74-9605-7bb090b3cc3e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:43.257839 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6450c98d-3340-4b00-be3a-a7b27465067a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:43.258491 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6450c98d-3340-4b00-be3a-a7b27465067a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:43.264822 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6450c98d-3340-4b00-be3a-a7b27465067a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:43.265302 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6450c98d-3340-4b00-be3a-a7b27465067a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:43.265744 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6450c98d-3340-4b00-be3a-a7b27465067a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:43.266411 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6450c98d-3340-4b00-be3a-a7b27465067a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:43.266860 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6450c98d-3340-4b00-be3a-a7b27465067a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:43.267270 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6450c98d-3340-4b00-be3a-a7b27465067a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:43.312109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-85618b41-f512-4d74-9605-7bb090b3cc3e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lazy-loading 'services' on Instance uuid fcf524cd-6e38-49e5-8e86-36f2b089ab1b {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:02:43.332794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6450c98d-3340-4b00-be3a-a7b27465067a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:43.343714 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6450c98d-3340-4b00-be3a-a7b27465067a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1193 microversion: 2.1 time: 0.089749 Oct 04 09:02:43.348552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 510/1070] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:43 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:43.388634 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-85618b41-f512-4d74-9605-7bb090b3cc3e tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments/f00cea1f-6124-4c99-9a94-a95e5f7738d2" status: 202 len: 0 microversion: 2.1 time: 0.177004 Oct 04 09:02:43.389338 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 561/1071] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Oct 4 09:02:43 2022] DELETE /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments/f00cea1f-6124-4c99-9a94-a95e5f7738d2 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:02:44.371665 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c9540582-3b9e-4b73-9fd9-aa7e5ce429bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:44.372300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c9540582-3b9e-4b73-9fd9-aa7e5ce429bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:44.378826 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c9540582-3b9e-4b73-9fd9-aa7e5ce429bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:44.379539 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c9540582-3b9e-4b73-9fd9-aa7e5ce429bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:44.380103 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c9540582-3b9e-4b73-9fd9-aa7e5ce429bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:44.380798 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c9540582-3b9e-4b73-9fd9-aa7e5ce429bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:44.381641 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c9540582-3b9e-4b73-9fd9-aa7e5ce429bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:44.382130 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c9540582-3b9e-4b73-9fd9-aa7e5ce429bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:44.519874 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c9540582-3b9e-4b73-9fd9-aa7e5ce429bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:44.528811 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c9540582-3b9e-4b73-9fd9-aa7e5ce429bf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1276 microversion: 2.1 time: 0.161813 Oct 04 09:02:44.529391 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 511/1072] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:44 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:44.958899 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-e66b7322-4a1d-4fe7-b53e-eaf90274df38 req-88997a5a-8675-4fb5-a9fe-7cedbb0a4a5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f473325-1877-43e1-8150-90eeadbdd17a", "tag": "e3ff2094-e984-4eea-ac2f-ef4e15fcfe78"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:02:44.968896 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-e66b7322-4a1d-4fe7-b53e-eaf90274df38 req-88997a5a-8675-4fb5-a9fe-7cedbb0a4a5f service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:44.969683 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-e66b7322-4a1d-4fe7-b53e-eaf90274df38 req-88997a5a-8675-4fb5-a9fe-7cedbb0a4a5f service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:44.969819 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-e66b7322-4a1d-4fe7-b53e-eaf90274df38 req-88997a5a-8675-4fb5-a9fe-7cedbb0a4a5f service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:44.982633 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-e66b7322-4a1d-4fe7-b53e-eaf90274df38 req-88997a5a-8675-4fb5-a9fe-7cedbb0a4a5f service nova] Creating event network-changed:e3ff2094-e984-4eea-ac2f-ef4e15fcfe78 for instance 4f473325-1877-43e1-8150-90eeadbdd17a on hv-cinder-84456 Oct 04 09:02:44.987341 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-e66b7322-4a1d-4fe7-b53e-eaf90274df38 req-88997a5a-8675-4fb5-a9fe-7cedbb0a4a5f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033141 Oct 04 09:02:44.987987 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 562/1073] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:45.552302 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-02be9151-9572-4a8e-a454-bfb2825927d5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:45.552933 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-02be9151-9572-4a8e-a454-bfb2825927d5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:45.559505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-02be9151-9572-4a8e-a454-bfb2825927d5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:45.560236 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-02be9151-9572-4a8e-a454-bfb2825927d5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:45.560673 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-02be9151-9572-4a8e-a454-bfb2825927d5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:45.561367 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-02be9151-9572-4a8e-a454-bfb2825927d5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:45.561816 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-02be9151-9572-4a8e-a454-bfb2825927d5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:45.562414 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-02be9151-9572-4a8e-a454-bfb2825927d5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:45.585676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-cbdda8d4-cfef-4a4d-b8bb-ce8e89646f62 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:45.586247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cbdda8d4-cfef-4a4d-b8bb-ce8e89646f62 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:45.592546 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cbdda8d4-cfef-4a4d-b8bb-ce8e89646f62 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:45.593055 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cbdda8d4-cfef-4a4d-b8bb-ce8e89646f62 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:45.593681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cbdda8d4-cfef-4a4d-b8bb-ce8e89646f62 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:45.594373 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cbdda8d4-cfef-4a4d-b8bb-ce8e89646f62 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:45.594978 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cbdda8d4-cfef-4a4d-b8bb-ce8e89646f62 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:45.595556 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cbdda8d4-cfef-4a4d-b8bb-ce8e89646f62 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:45.628856 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-cbdda8d4-cfef-4a4d-b8bb-ce8e89646f62 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments/99e36528-8c95-48fe-8b98-fa9bac40f211" status: 200 len: 194 microversion: 2.1 time: 0.047166 Oct 04 09:02:45.629675 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 563/1074] 10.222.0.44 () {58 vars in 1413 bytes} [Tue Oct 4 09:02:45 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments/99e36528-8c95-48fe-8b98-fa9bac40f211 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 09:02:45.639995 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4a4c355f-4041-43ec-9dad-7d122f78754b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:45.640495 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4a4c355f-4041-43ec-9dad-7d122f78754b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:45.646452 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4a4c355f-4041-43ec-9dad-7d122f78754b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:45.646947 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4a4c355f-4041-43ec-9dad-7d122f78754b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:45.647378 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4a4c355f-4041-43ec-9dad-7d122f78754b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:45.648112 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4a4c355f-4041-43ec-9dad-7d122f78754b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:45.648562 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4a4c355f-4041-43ec-9dad-7d122f78754b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:45.648984 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4a4c355f-4041-43ec-9dad-7d122f78754b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:45.703804 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-02be9151-9572-4a8e-a454-bfb2825927d5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:45.712252 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-02be9151-9572-4a8e-a454-bfb2825927d5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1264 microversion: 2.1 time: 0.163719 Oct 04 09:02:45.712993 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 512/1075] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:45 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:45.731731 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-4a4c355f-4041-43ec-9dad-7d122f78754b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lazy-loading 'services' on Instance uuid fcf524cd-6e38-49e5-8e86-36f2b089ab1b {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:02:45.810927 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4a4c355f-4041-43ec-9dad-7d122f78754b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments/99e36528-8c95-48fe-8b98-fa9bac40f211" status: 202 len: 0 microversion: 2.1 time: 0.174577 Oct 04 09:02:45.811629 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 564/1076] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Oct 4 09:02:45 2022] DELETE /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments/99e36528-8c95-48fe-8b98-fa9bac40f211 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 09:02:46.735928 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-36daf665-b8eb-4dbd-b312-9eab10ccbd62 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:46.736585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-36daf665-b8eb-4dbd-b312-9eab10ccbd62 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:46.746735 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-36daf665-b8eb-4dbd-b312-9eab10ccbd62 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:46.747329 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-36daf665-b8eb-4dbd-b312-9eab10ccbd62 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:46.747914 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-36daf665-b8eb-4dbd-b312-9eab10ccbd62 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:46.748981 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-36daf665-b8eb-4dbd-b312-9eab10ccbd62 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:46.749627 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-36daf665-b8eb-4dbd-b312-9eab10ccbd62 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:46.750239 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-36daf665-b8eb-4dbd-b312-9eab10ccbd62 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:46.890181 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-36daf665-b8eb-4dbd-b312-9eab10ccbd62 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:46.899299 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-36daf665-b8eb-4dbd-b312-9eab10ccbd62 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1264 microversion: 2.1 time: 0.167676 Oct 04 09:02:46.899929 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 513/1077] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:46 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:47.921826 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-179d068c-47f1-40ef-9b29-308f6516aca5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:47.922540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-179d068c-47f1-40ef-9b29-308f6516aca5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:47.930172 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-179d068c-47f1-40ef-9b29-308f6516aca5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:47.930948 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-179d068c-47f1-40ef-9b29-308f6516aca5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:47.931423 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-179d068c-47f1-40ef-9b29-308f6516aca5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:47.932155 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-179d068c-47f1-40ef-9b29-308f6516aca5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:47.932610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-179d068c-47f1-40ef-9b29-308f6516aca5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:47.933130 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-179d068c-47f1-40ef-9b29-308f6516aca5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:48.063315 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a088306c-422a-4e76-ac59-1818476d4426 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:48.066052 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a088306c-422a-4e76-ac59-1818476d4426 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:48.073069 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a088306c-422a-4e76-ac59-1818476d4426 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:48.073561 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a088306c-422a-4e76-ac59-1818476d4426 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:48.073996 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a088306c-422a-4e76-ac59-1818476d4426 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:48.074710 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a088306c-422a-4e76-ac59-1818476d4426 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:48.075164 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a088306c-422a-4e76-ac59-1818476d4426 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:48.075715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a088306c-422a-4e76-ac59-1818476d4426 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:48.097443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-179d068c-47f1-40ef-9b29-308f6516aca5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:48.105995 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-179d068c-47f1-40ef-9b29-308f6516aca5 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1264 microversion: 2.1 time: 0.188398 Oct 04 09:02:48.106732 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 565/1078] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:47 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:48.108645 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a088306c-422a-4e76-ac59-1818476d4426 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050518 Oct 04 09:02:48.109194 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 514/1079] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:02:48 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 09:02:48.412379 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8e3dce42-b414-4da5-b351-e9a6bc9efad7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:48.415212 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8e3dce42-b414-4da5-b351-e9a6bc9efad7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:48.422129 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e3dce42-b414-4da5-b351-e9a6bc9efad7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:48.422599 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e3dce42-b414-4da5-b351-e9a6bc9efad7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:48.423024 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e3dce42-b414-4da5-b351-e9a6bc9efad7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:48.423702 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e3dce42-b414-4da5-b351-e9a6bc9efad7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:48.424176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e3dce42-b414-4da5-b351-e9a6bc9efad7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:48.424579 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8e3dce42-b414-4da5-b351-e9a6bc9efad7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:48.456615 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8e3dce42-b414-4da5-b351-e9a6bc9efad7 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048833 Oct 04 09:02:48.456961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 566/1080] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:02:48 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 09:02:48.523264 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-af11f367-ebdb-4d80-be5e-2efe10a4a01c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:48.523759 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-af11f367-ebdb-4d80-be5e-2efe10a4a01c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:48.530373 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-af11f367-ebdb-4d80-be5e-2efe10a4a01c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:48.530854 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-af11f367-ebdb-4d80-be5e-2efe10a4a01c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:48.531282 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-af11f367-ebdb-4d80-be5e-2efe10a4a01c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:48.531994 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-af11f367-ebdb-4d80-be5e-2efe10a4a01c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:48.532444 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-af11f367-ebdb-4d80-be5e-2efe10a4a01c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:48.532860 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-af11f367-ebdb-4d80-be5e-2efe10a4a01c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:48.557293 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-af11f367-ebdb-4d80-be5e-2efe10a4a01c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Going to try to terminate instance {{(pid=142439) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:02:48.639789 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-af11f367-ebdb-4d80-be5e-2efe10a4a01c tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 204 len: 0 microversion: 2.1 time: 0.120020 Oct 04 09:02:48.640391 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 515/1081] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:02:48 2022] DELETE /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:02:48.649854 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b84f130e-0ccd-4e64-af73-00001edeec6b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:48.650656 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b84f130e-0ccd-4e64-af73-00001edeec6b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:48.657759 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b84f130e-0ccd-4e64-af73-00001edeec6b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:48.658246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b84f130e-0ccd-4e64-af73-00001edeec6b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:48.658676 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b84f130e-0ccd-4e64-af73-00001edeec6b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:48.659384 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b84f130e-0ccd-4e64-af73-00001edeec6b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:48.659831 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b84f130e-0ccd-4e64-af73-00001edeec6b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:48.660283 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b84f130e-0ccd-4e64-af73-00001edeec6b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:48.804720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b84f130e-0ccd-4e64-af73-00001edeec6b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:48.812563 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b84f130e-0ccd-4e64-af73-00001edeec6b tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 200 len: 1674 microversion: 2.1 time: 0.167679 Oct 04 09:02:48.813172 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 567/1082] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:48 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:49.134779 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-dc666d77-c43b-41c6-bcf1-a3e1e7207616 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:49.135966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-dc666d77-c43b-41c6-bcf1-a3e1e7207616 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:49.146667 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc666d77-c43b-41c6-bcf1-a3e1e7207616 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:49.147469 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc666d77-c43b-41c6-bcf1-a3e1e7207616 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:49.148246 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc666d77-c43b-41c6-bcf1-a3e1e7207616 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:49.149374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc666d77-c43b-41c6-bcf1-a3e1e7207616 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:49.150137 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc666d77-c43b-41c6-bcf1-a3e1e7207616 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:49.150837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc666d77-c43b-41c6-bcf1-a3e1e7207616 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:49.286932 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dc666d77-c43b-41c6-bcf1-a3e1e7207616 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:49.294739 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-dc666d77-c43b-41c6-bcf1-a3e1e7207616 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1264 microversion: 2.1 time: 0.167205 Oct 04 09:02:49.295293 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 516/1083] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:49 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:49.840001 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-576b6e03-efe2-4d57-9fd0-55445222b810 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:49.840945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-576b6e03-efe2-4d57-9fd0-55445222b810 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:49.848555 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-576b6e03-efe2-4d57-9fd0-55445222b810 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:49.849045 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-576b6e03-efe2-4d57-9fd0-55445222b810 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:49.849487 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-576b6e03-efe2-4d57-9fd0-55445222b810 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:49.850186 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-576b6e03-efe2-4d57-9fd0-55445222b810 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:49.850639 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-576b6e03-efe2-4d57-9fd0-55445222b810 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:49.851066 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-576b6e03-efe2-4d57-9fd0-55445222b810 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:49.983708 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-576b6e03-efe2-4d57-9fd0-55445222b810 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:49.991702 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-576b6e03-efe2-4d57-9fd0-55445222b810 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 200 len: 1674 microversion: 2.1 time: 0.158278 Oct 04 09:02:49.992302 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 568/1084] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:49 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:50.317935 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a79e44b0-c4a7-4d84-b364-47fe5d839d28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:50.318530 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a79e44b0-c4a7-4d84-b364-47fe5d839d28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:50.325468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a79e44b0-c4a7-4d84-b364-47fe5d839d28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:50.325934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a79e44b0-c4a7-4d84-b364-47fe5d839d28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:50.326367 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a79e44b0-c4a7-4d84-b364-47fe5d839d28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:50.327147 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a79e44b0-c4a7-4d84-b364-47fe5d839d28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:50.327621 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a79e44b0-c4a7-4d84-b364-47fe5d839d28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:50.328089 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a79e44b0-c4a7-4d84-b364-47fe5d839d28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:50.461128 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a79e44b0-c4a7-4d84-b364-47fe5d839d28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:50.469096 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a79e44b0-c4a7-4d84-b364-47fe5d839d28 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1264 microversion: 2.1 time: 0.155159 Oct 04 09:02:50.469966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 517/1085] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:50 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:51.015040 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c63cb6a6-b235-42e1-9f92-f92c0ff82e60 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:51.015604 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c63cb6a6-b235-42e1-9f92-f92c0ff82e60 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:51.022388 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c63cb6a6-b235-42e1-9f92-f92c0ff82e60 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:51.022875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c63cb6a6-b235-42e1-9f92-f92c0ff82e60 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:51.023315 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c63cb6a6-b235-42e1-9f92-f92c0ff82e60 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:51.024084 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c63cb6a6-b235-42e1-9f92-f92c0ff82e60 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:51.024538 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c63cb6a6-b235-42e1-9f92-f92c0ff82e60 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:51.024973 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c63cb6a6-b235-42e1-9f92-f92c0ff82e60 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:51.166294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c63cb6a6-b235-42e1-9f92-f92c0ff82e60 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:51.174359 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c63cb6a6-b235-42e1-9f92-f92c0ff82e60 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 200 len: 1674 microversion: 2.1 time: 0.163395 Oct 04 09:02:51.174953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 569/1086] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:51 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:51.494031 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-dc6299c8-e40b-4673-825e-aa9f0c00f6b7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:51.495983 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-dc6299c8-e40b-4673-825e-aa9f0c00f6b7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:51.502752 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc6299c8-e40b-4673-825e-aa9f0c00f6b7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:51.503327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc6299c8-e40b-4673-825e-aa9f0c00f6b7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:51.503829 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc6299c8-e40b-4673-825e-aa9f0c00f6b7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:51.504621 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc6299c8-e40b-4673-825e-aa9f0c00f6b7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:51.505076 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc6299c8-e40b-4673-825e-aa9f0c00f6b7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:51.505500 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc6299c8-e40b-4673-825e-aa9f0c00f6b7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:51.641919 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dc6299c8-e40b-4673-825e-aa9f0c00f6b7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:51.650248 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-dc6299c8-e40b-4673-825e-aa9f0c00f6b7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1264 microversion: 2.1 time: 0.162062 Oct 04 09:02:51.651048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 518/1087] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:51 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:51.940801 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-5bb6bf06-38d2-42b7-81e3-0d64447c3e7e req-ef27f6aa-1478-47aa-9e7d-8df93153daf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf524cd-6e38-49e5-8e86-36f2b089ab1b", "name": "network-vif-deleted", "tag": "9d933822-6ec8-4793-8ee8-cc7fd4f83411"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:02:51.946308 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:51.952568 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-5bb6bf06-38d2-42b7-81e3-0d64447c3e7e req-ef27f6aa-1478-47aa-9e7d-8df93153daf3 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:51.953048 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-5bb6bf06-38d2-42b7-81e3-0d64447c3e7e req-ef27f6aa-1478-47aa-9e7d-8df93153daf3 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:51.953653 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-5bb6bf06-38d2-42b7-81e3-0d64447c3e7e req-ef27f6aa-1478-47aa-9e7d-8df93153daf3 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:51.967508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=6 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:51.974385 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-5bb6bf06-38d2-42b7-81e3-0d64447c3e7e req-ef27f6aa-1478-47aa-9e7d-8df93153daf3 service nova] Creating event network-vif-deleted:9d933822-6ec8-4793-8ee8-cc7fd4f83411 for instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b on hv-cinder-84456 Oct 04 09:02:51.980182 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-5bb6bf06-38d2-42b7-81e3-0d64447c3e7e req-ef27f6aa-1478-47aa-9e7d-8df93153daf3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043160 Oct 04 09:02:51.981075 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 570/1088] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:52.198099 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b9f507c4-6f27-4cc7-a14f-daa5b810d81d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:52.199123 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b9f507c4-6f27-4cc7-a14f-daa5b810d81d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:52.206115 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9f507c4-6f27-4cc7-a14f-daa5b810d81d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:52.206757 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9f507c4-6f27-4cc7-a14f-daa5b810d81d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:52.207272 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9f507c4-6f27-4cc7-a14f-daa5b810d81d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:52.208092 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9f507c4-6f27-4cc7-a14f-daa5b810d81d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:52.208655 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9f507c4-6f27-4cc7-a14f-daa5b810d81d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:52.209151 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9f507c4-6f27-4cc7-a14f-daa5b810d81d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:52.234980 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:52.248626 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9f507c4-6f27-4cc7-a14f-daa5b810d81d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:52.249374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9f507c4-6f27-4cc7-a14f-daa5b810d81d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:52.249816 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b9f507c4-6f27-4cc7-a14f-daa5b810d81d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:52.250323 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-b9f507c4-6f27-4cc7-a14f-daa5b810d81d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lazy-loading 'fault' on Instance uuid fcf524cd-6e38-49e5-8e86-36f2b089ab1b {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:02:52.291455 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b9f507c4-6f27-4cc7-a14f-daa5b810d81d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:52.299253 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b9f507c4-6f27-4cc7-a14f-daa5b810d81d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 200 len: 1327 microversion: 2.1 time: 0.105274 Oct 04 09:02:52.299823 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 519/1089] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:52 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:52.674875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-177d0545-bade-4a32-b8af-79cb7079b1c6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:52.675604 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-177d0545-bade-4a32-b8af-79cb7079b1c6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:52.682507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-177d0545-bade-4a32-b8af-79cb7079b1c6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:52.682961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-177d0545-bade-4a32-b8af-79cb7079b1c6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:52.683389 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-177d0545-bade-4a32-b8af-79cb7079b1c6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:52.684096 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-177d0545-bade-4a32-b8af-79cb7079b1c6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:52.684545 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-177d0545-bade-4a32-b8af-79cb7079b1c6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:52.684962 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-177d0545-bade-4a32-b8af-79cb7079b1c6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:52.840448 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-177d0545-bade-4a32-b8af-79cb7079b1c6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:52.848900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-177d0545-bade-4a32-b8af-79cb7079b1c6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1264 microversion: 2.1 time: 0.178329 Oct 04 09:02:52.849481 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 571/1090] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:52 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:53.326864 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fc23bd67-69c3-453f-bfcb-55ff670cafa2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:53.327552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-fc23bd67-69c3-453f-bfcb-55ff670cafa2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:53.336102 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc23bd67-69c3-453f-bfcb-55ff670cafa2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:53.336704 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc23bd67-69c3-453f-bfcb-55ff670cafa2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:53.337248 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc23bd67-69c3-453f-bfcb-55ff670cafa2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:53.338116 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc23bd67-69c3-453f-bfcb-55ff670cafa2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:53.338677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc23bd67-69c3-453f-bfcb-55ff670cafa2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:53.339210 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc23bd67-69c3-453f-bfcb-55ff670cafa2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:53.344192 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:53.376620 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc23bd67-69c3-453f-bfcb-55ff670cafa2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:53.377077 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc23bd67-69c3-453f-bfcb-55ff670cafa2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:53.377591 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fc23bd67-69c3-453f-bfcb-55ff670cafa2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:53.378028 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-fc23bd67-69c3-453f-bfcb-55ff670cafa2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lazy-loading 'fault' on Instance uuid fcf524cd-6e38-49e5-8e86-36f2b089ab1b {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:02:53.417832 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-fc23bd67-69c3-453f-bfcb-55ff670cafa2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71984f02fcd4deba5e1430ec85b8705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ad37ea522247c6b28ea40e1bc43669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:53.425643 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fc23bd67-69c3-453f-bfcb-55ff670cafa2 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 200 len: 1327 microversion: 2.1 time: 0.105488 Oct 04 09:02:53.426204 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 520/1091] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:53 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:53.874466 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c62a133e-925b-462a-8288-03cc11223f56 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:53.875073 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c62a133e-925b-462a-8288-03cc11223f56 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:53.877635 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:53.882977 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c62a133e-925b-462a-8288-03cc11223f56 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:53.883458 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c62a133e-925b-462a-8288-03cc11223f56 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:53.883915 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c62a133e-925b-462a-8288-03cc11223f56 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:53.884624 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c62a133e-925b-462a-8288-03cc11223f56 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:53.885058 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c62a133e-925b-462a-8288-03cc11223f56 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:53.885487 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c62a133e-925b-462a-8288-03cc11223f56 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:53.889019 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:54.025229 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c62a133e-925b-462a-8288-03cc11223f56 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:54.033224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c62a133e-925b-462a-8288-03cc11223f56 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1264 microversion: 2.1 time: 0.162943 Oct 04 09:02:54.033802 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 572/1092] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:53 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:54.448656 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9399767c-2c88-496f-88b9-75540ae1acb1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:54.449400 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9399767c-2c88-496f-88b9-75540ae1acb1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:54.456269 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9399767c-2c88-496f-88b9-75540ae1acb1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:54.456762 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9399767c-2c88-496f-88b9-75540ae1acb1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:54.457197 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9399767c-2c88-496f-88b9-75540ae1acb1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:54.457906 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9399767c-2c88-496f-88b9-75540ae1acb1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:54.458354 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9399767c-2c88-496f-88b9-75540ae1acb1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:54.458785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9399767c-2c88-496f-88b9-75540ae1acb1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:54.472720 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-9399767c-2c88-496f-88b9-75540ae1acb1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] HTTP exception thrown: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9399767c-2c88-496f-88b9-75540ae1acb1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Request method failure captured: Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b HTTP/1.1 Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_SX1mQUowrwr4CF41WchcB8Z4uueLDMnrte3fNgF_nm7WpEQIgaMQ6118JNMrNXXRFMp6bsSZgs_L-Y5M4CCjYW3UYcqrAytuJwfE-hnL8T8c36V_TH5jHUGZsGSck6lF1D2hGa-AcM8WvyOOlftc_6o3nEmyIsu3axlf5TTGbeX7U Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: b7ad37ea522247c6b28ea40e1bc43669 Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:02:54.474408 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:02:54.475979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b7ad37ea522247c6b28ea40e1bc43669", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:02:54.475979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:02:54.475979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: b7ad37ea522247c6b28ea40e1bc43669 Oct 04 09:02:54.475979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:02:54.475979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-AttachVolumeTestJSON-610189389-project Oct 04 09:02:54.475979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:02:54.475979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:02:54.475979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: e71984f02fcd4deba5e1430ec85b8705 Oct 04 09:02:54.475979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-AttachVolumeTestJSON-610189389-project Oct 04 09:02:54.475979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:02:54.475979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. Oct 04 09:02:54.475979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': 'fcf524cd-6e38-49e5-8e86-36f2b089ab1b'} Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:02:54.477029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. Oct 04 09:02:54.478501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:54.479993 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9399767c-2c88-496f-88b9-75540ae1acb1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Returning 404 to user: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:02:54.479993 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9399767c-2c88-496f-88b9-75540ae1acb1 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 404 len: 111 microversion: 2.1 time: 0.031209 Oct 04 09:02:54.479993 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 521/1093] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:54 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:02:54.486131 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0a9bc56a-656c-49c4-a3f8-ad7e0e5be012 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '.version_select at 0x7ff92e3b31f0>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:54.508604 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0a9bc56a-656c-49c4-a3f8-ad7e0e5be012 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188627538" status: 202 len: 0 microversion: 2.1 time: 0.026844 Oct 04 09:02:54.509316 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 573/1094] 10.222.0.44 () {58 vars in 1221 bytes} [Tue Oct 4 09:02:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188627538 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:02:55.056058 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f9fae357-e2e9-4e65-92ab-57a5d641439b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:55.056769 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f9fae357-e2e9-4e65-92ab-57a5d641439b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:55.063263 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9fae357-e2e9-4e65-92ab-57a5d641439b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:55.063731 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9fae357-e2e9-4e65-92ab-57a5d641439b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:55.064224 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9fae357-e2e9-4e65-92ab-57a5d641439b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:55.065087 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9fae357-e2e9-4e65-92ab-57a5d641439b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:55.065543 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9fae357-e2e9-4e65-92ab-57a5d641439b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:55.065984 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f9fae357-e2e9-4e65-92ab-57a5d641439b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:55.208785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f9fae357-e2e9-4e65-92ab-57a5d641439b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:55.217226 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f9fae357-e2e9-4e65-92ab-57a5d641439b tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1264 microversion: 2.1 time: 0.165108 Oct 04 09:02:55.217878 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 522/1095] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:55 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:55.989477 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-14c04167-6ab0-4b8b-8049-5b76c66dacec req-4fd5b4db-7f66-45ba-bb4f-ace514841349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f473325-1877-43e1-8150-90eeadbdd17a", "name": "network-vif-plugged", "status": "completed", "tag": "e3ff2094-e984-4eea-ac2f-ef4e15fcfe78"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:02:56.002108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-14c04167-6ab0-4b8b-8049-5b76c66dacec req-4fd5b4db-7f66-45ba-bb4f-ace514841349 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:56.002585 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-14c04167-6ab0-4b8b-8049-5b76c66dacec req-4fd5b4db-7f66-45ba-bb4f-ace514841349 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:56.003016 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-14c04167-6ab0-4b8b-8049-5b76c66dacec req-4fd5b4db-7f66-45ba-bb4f-ace514841349 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:56.013443 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-14c04167-6ab0-4b8b-8049-5b76c66dacec req-4fd5b4db-7f66-45ba-bb4f-ace514841349 service nova] Creating event network-vif-plugged:e3ff2094-e984-4eea-ac2f-ef4e15fcfe78 for instance 4f473325-1877-43e1-8150-90eeadbdd17a on hv-cinder-84456 Oct 04 09:02:56.018483 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-14c04167-6ab0-4b8b-8049-5b76c66dacec req-4fd5b4db-7f66-45ba-bb4f-ace514841349 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032844 Oct 04 09:02:56.019253 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 574/1096] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:56.246356 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4756193b-ba6a-4c8b-acc7-3c8600b7c429 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:56.247175 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4756193b-ba6a-4c8b-acc7-3c8600b7c429 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:56.254455 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4756193b-ba6a-4c8b-acc7-3c8600b7c429 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:56.255026 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4756193b-ba6a-4c8b-acc7-3c8600b7c429 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:56.255535 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4756193b-ba6a-4c8b-acc7-3c8600b7c429 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:56.256480 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4756193b-ba6a-4c8b-acc7-3c8600b7c429 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:56.256935 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4756193b-ba6a-4c8b-acc7-3c8600b7c429 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:56.258017 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4756193b-ba6a-4c8b-acc7-3c8600b7c429 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:56.426640 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4756193b-ba6a-4c8b-acc7-3c8600b7c429 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:56.434369 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4756193b-ba6a-4c8b-acc7-3c8600b7c429 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1264 microversion: 2.1 time: 0.192497 Oct 04 09:02:56.434944 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 523/1097] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:56 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:57.451640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c50b52bd-8a80-4efd-b483-80624ce7e996 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:57.452251 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c50b52bd-8a80-4efd-b483-80624ce7e996 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:57.456580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-effad8d6-7631-4bee-bd9c-b1ea8c2aaec7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:57.457184 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-effad8d6-7631-4bee-bd9c-b1ea8c2aaec7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:57.458801 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c50b52bd-8a80-4efd-b483-80624ce7e996 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:57.459285 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c50b52bd-8a80-4efd-b483-80624ce7e996 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:57.459713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c50b52bd-8a80-4efd-b483-80624ce7e996 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:57.460445 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c50b52bd-8a80-4efd-b483-80624ce7e996 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:57.460896 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c50b52bd-8a80-4efd-b483-80624ce7e996 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:57.461317 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c50b52bd-8a80-4efd-b483-80624ce7e996 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:57.463768 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-effad8d6-7631-4bee-bd9c-b1ea8c2aaec7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:57.464296 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-effad8d6-7631-4bee-bd9c-b1ea8c2aaec7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:57.464723 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-effad8d6-7631-4bee-bd9c-b1ea8c2aaec7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:57.465407 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-effad8d6-7631-4bee-bd9c-b1ea8c2aaec7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:57.465851 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-effad8d6-7631-4bee-bd9c-b1ea8c2aaec7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:57.466275 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-effad8d6-7631-4bee-bd9c-b1ea8c2aaec7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:57.475227 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-c50b52bd-8a80-4efd-b483-80624ce7e996 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] HTTP exception thrown: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c50b52bd-8a80-4efd-b483-80624ce7e996 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Request method failure captured: Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: DELETE /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b HTTP/1.1 Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_SX1mQUowrwr4CF41WchcB8Z4uueLDMnrte3fNgF_nm7WpEQIgaMQ6118JNMrNXXRFMp6bsSZgs_L-Y5M4CCjYW3UYcqrAytuJwfE-hnL8T8c36V_TH5jHUGZsGSck6lF1D2hGa-AcM8WvyOOlftc_6o3nEmyIsu3axlf5TTGbeX7U Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: b7ad37ea522247c6b28ea40e1bc43669 Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:02:57.476933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:02:57.478343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b7ad37ea522247c6b28ea40e1bc43669", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:02:57.478343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:02:57.478343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: b7ad37ea522247c6b28ea40e1bc43669 Oct 04 09:02:57.478343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:02:57.478343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-AttachVolumeTestJSON-610189389-project Oct 04 09:02:57.478343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:02:57.478343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:02:57.478343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: e71984f02fcd4deba5e1430ec85b8705 Oct 04 09:02:57.478343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-AttachVolumeTestJSON-610189389-project Oct 04 09:02:57.478343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:02:57.478343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. Oct 04 09:02:57.478343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': 'fcf524cd-6e38-49e5-8e86-36f2b089ab1b'} Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:02:57.479133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. Oct 04 09:02:57.481343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:02:57.483343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c50b52bd-8a80-4efd-b483-80624ce7e996 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Returning 404 to user: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:02:57.483343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c50b52bd-8a80-4efd-b483-80624ce7e996 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 404 len: 111 microversion: 2.1 time: 0.031626 Oct 04 09:02:57.483343 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 575/1098] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:02:57 2022] DELETE /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:02:57.487565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-51c1e02e-e6f5-4c14-af60-f06a1af36e9d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:57.488294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-51c1e02e-e6f5-4c14-af60-f06a1af36e9d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: fcf524cd-6e38-49e5-8e86-36f2b089ab1b] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:57.494682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-51c1e02e-e6f5-4c14-af60-f06a1af36e9d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:57.495174 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-51c1e02e-e6f5-4c14-af60-f06a1af36e9d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:57.495650 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-51c1e02e-e6f5-4c14-af60-f06a1af36e9d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:57.496398 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-51c1e02e-e6f5-4c14-af60-f06a1af36e9d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:57.496852 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-51c1e02e-e6f5-4c14-af60-f06a1af36e9d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:57.497276 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-51c1e02e-e6f5-4c14-af60-f06a1af36e9d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:57.511422 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-51c1e02e-e6f5-4c14-af60-f06a1af36e9d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] HTTP exception thrown: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-51c1e02e-e6f5-4c14-af60-f06a1af36e9d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Request method failure captured: Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b HTTP/1.1 Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_SX1mQUowrwr4CF41WchcB8Z4uueLDMnrte3fNgF_nm7WpEQIgaMQ6118JNMrNXXRFMp6bsSZgs_L-Y5M4CCjYW3UYcqrAytuJwfE-hnL8T8c36V_TH5jHUGZsGSck6lF1D2hGa-AcM8WvyOOlftc_6o3nEmyIsu3axlf5TTGbeX7U Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: b7ad37ea522247c6b28ea40e1bc43669 Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:02:57.513013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:02:57.514687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b7ad37ea522247c6b28ea40e1bc43669", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:02:57.514687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:02:57.514687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: b7ad37ea522247c6b28ea40e1bc43669 Oct 04 09:02:57.514687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:02:57.514687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-AttachVolumeTestJSON-610189389-project Oct 04 09:02:57.514687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:02:57.514687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:02:57.514687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: e71984f02fcd4deba5e1430ec85b8705 Oct 04 09:02:57.514687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-AttachVolumeTestJSON-610189389-project Oct 04 09:02:57.514687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:02:57.514687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. Oct 04 09:02:57.514687 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': 'fcf524cd-6e38-49e5-8e86-36f2b089ab1b'} Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:02:57.515565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. Oct 04 09:02:57.517260 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:02:57.518545 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-51c1e02e-e6f5-4c14-af60-f06a1af36e9d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Returning 404 to user: Instance fcf524cd-6e38-49e5-8e86-36f2b089ab1b could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:02:57.518545 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-51c1e02e-e6f5-4c14-af60-f06a1af36e9d tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b" status: 404 len: 111 microversion: 2.1 time: 0.030807 Oct 04 09:02:57.518545 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 576/1099] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:57 2022] GET /compute/v2.1/servers/fcf524cd-6e38-49e5-8e86-36f2b089ab1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:02:57.608935 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-effad8d6-7631-4bee-bd9c-b1ea8c2aaec7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:57.617036 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-effad8d6-7631-4bee-bd9c-b1ea8c2aaec7 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1264 microversion: 2.1 time: 0.164267 Oct 04 09:02:57.629156 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 524/1100] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:57 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:58.644911 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-dd9218c9-7012-41c0-81f6-a121f55cb6ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:58.646048 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-dd9218c9-7012-41c0-81f6-a121f55cb6ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:58.656754 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dd9218c9-7012-41c0-81f6-a121f55cb6ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:58.657234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dd9218c9-7012-41c0-81f6-a121f55cb6ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:58.657666 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dd9218c9-7012-41c0-81f6-a121f55cb6ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:58.658354 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dd9218c9-7012-41c0-81f6-a121f55cb6ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:58.658804 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dd9218c9-7012-41c0-81f6-a121f55cb6ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:58.659223 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dd9218c9-7012-41c0-81f6-a121f55cb6ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:58.671552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-11338c72-f8d8-43d4-bc4a-c24a89a57d48 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:58.672111 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-11338c72-f8d8-43d4-bc4a-c24a89a57d48 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:58.678764 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-11338c72-f8d8-43d4-bc4a-c24a89a57d48 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:58.679249 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-11338c72-f8d8-43d4-bc4a-c24a89a57d48 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:58.679680 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-11338c72-f8d8-43d4-bc4a-c24a89a57d48 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:58.680438 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-11338c72-f8d8-43d4-bc4a-c24a89a57d48 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:58.680883 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-11338c72-f8d8-43d4-bc4a-c24a89a57d48 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:58.681295 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-11338c72-f8d8-43d4-bc4a-c24a89a57d48 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:58.695137 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-11338c72-f8d8-43d4-bc4a-c24a89a57d48 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] HTTP exception thrown: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-11338c72-f8d8-43d4-bc4a-c24a89a57d48 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Request method failure captured: Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: DELETE /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f HTTP/1.1 Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_SX1mQUowrwr4CF41WchcB8Z4uueLDMnrte3fNgF_nm7WpEQIgaMQ6118JNMrNXXRFMp6bsSZgs_L-Y5M4CCjYW3UYcqrAytuJwfE-hnL8T8c36V_TH5jHUGZsGSck6lF1D2hGa-AcM8WvyOOlftc_6o3nEmyIsu3axlf5TTGbeX7U Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: b7ad37ea522247c6b28ea40e1bc43669 Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:02:58.696783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:02:58.698432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b7ad37ea522247c6b28ea40e1bc43669", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:02:58.698432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:02:58.698432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: b7ad37ea522247c6b28ea40e1bc43669 Oct 04 09:02:58.698432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:02:58.698432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-AttachVolumeTestJSON-610189389-project Oct 04 09:02:58.698432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:02:58.698432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:02:58.698432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: e71984f02fcd4deba5e1430ec85b8705 Oct 04 09:02:58.698432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-AttachVolumeTestJSON-610189389-project Oct 04 09:02:58.698432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:02:58.698432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. Oct 04 09:02:58.698432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': '86725d76-c18e-4df2-94ff-93d73b5bc65f'} Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:02:58.699357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. Oct 04 09:02:58.700966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:58.702240 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-11338c72-f8d8-43d4-bc4a-c24a89a57d48 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Returning 404 to user: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:02:58.702240 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-11338c72-f8d8-43d4-bc4a-c24a89a57d48 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "DELETE /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 404 len: 111 microversion: 2.1 time: 0.030567 Oct 04 09:02:58.702240 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 525/1101] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:02:58 2022] DELETE /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:02:58.706484 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-083d5b60-df20-49c6-8129-cfc6e320c1f0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:58.707063 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-083d5b60-df20-49c6-8129-cfc6e320c1f0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] [instance: 86725d76-c18e-4df2-94ff-93d73b5bc65f] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:58.713169 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-083d5b60-df20-49c6-8129-cfc6e320c1f0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:58.713644 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-083d5b60-df20-49c6-8129-cfc6e320c1f0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:58.714075 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-083d5b60-df20-49c6-8129-cfc6e320c1f0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:58.714741 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-083d5b60-df20-49c6-8129-cfc6e320c1f0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:58.715185 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-083d5b60-df20-49c6-8129-cfc6e320c1f0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:58.715599 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-083d5b60-df20-49c6-8129-cfc6e320c1f0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:58.728986 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-083d5b60-df20-49c6-8129-cfc6e320c1f0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] HTTP exception thrown: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-083d5b60-df20-49c6-8129-cfc6e320c1f0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Request method failure captured: Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f HTTP/1.1 Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_SX1mQUowrwr4CF41WchcB8Z4uueLDMnrte3fNgF_nm7WpEQIgaMQ6118JNMrNXXRFMp6bsSZgs_L-Y5M4CCjYW3UYcqrAytuJwfE-hnL8T8c36V_TH5jHUGZsGSck6lF1D2hGa-AcM8WvyOOlftc_6o3nEmyIsu3axlf5TTGbeX7U Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: b7ad37ea522247c6b28ea40e1bc43669 Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:02:58.730504 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:02:58.731856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b7ad37ea522247c6b28ea40e1bc43669", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b7ad37ea522247c6b28ea40e1bc43669"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:02:58.731856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:02:58.731856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: b7ad37ea522247c6b28ea40e1bc43669 Oct 04 09:02:58.731856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-AttachVolumeTestJSON-610189389 Oct 04 09:02:58.731856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-AttachVolumeTestJSON-610189389-project Oct 04 09:02:58.731856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:02:58.731856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:02:58.731856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: e71984f02fcd4deba5e1430ec85b8705 Oct 04 09:02:58.731856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-AttachVolumeTestJSON-610189389-project Oct 04 09:02:58.731856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:02:58.731856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. Oct 04 09:02:58.731856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': '86725d76-c18e-4df2-94ff-93d73b5bc65f'} Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:02:58.732719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. Oct 04 09:02:58.733990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:02:58.735069 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-083d5b60-df20-49c6-8129-cfc6e320c1f0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] Returning 404 to user: Instance 86725d76-c18e-4df2-94ff-93d73b5bc65f could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:02:58.735069 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-083d5b60-df20-49c6-8129-cfc6e320c1f0 tempest-AttachVolumeTestJSON-610189389 tempest-AttachVolumeTestJSON-610189389-project] 10.222.0.44 "GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f" status: 404 len: 111 microversion: 2.1 time: 0.029101 Oct 04 09:02:58.735069 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 526/1102] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:58 2022] GET /compute/v2.1/servers/86725d76-c18e-4df2-94ff-93d73b5bc65f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:02:58.795186 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-dd9218c9-7012-41c0-81f6-a121f55cb6ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:58.803148 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-dd9218c9-7012-41c0-81f6-a121f55cb6ec tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1450 microversion: 2.1 time: 0.164671 Oct 04 09:02:58.803751 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 577/1103] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:58 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:58.825384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2e00a8fd-cea1-4461-b83b-e0e05754e3cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:58.826001 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2e00a8fd-cea1-4461-b83b-e0e05754e3cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:58.832218 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2e00a8fd-cea1-4461-b83b-e0e05754e3cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:58.832705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2e00a8fd-cea1-4461-b83b-e0e05754e3cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:58.833146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2e00a8fd-cea1-4461-b83b-e0e05754e3cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:58.833852 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2e00a8fd-cea1-4461-b83b-e0e05754e3cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:58.834309 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2e00a8fd-cea1-4461-b83b-e0e05754e3cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:58.834734 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2e00a8fd-cea1-4461-b83b-e0e05754e3cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:58.975233 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2e00a8fd-cea1-4461-b83b-e0e05754e3cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:58.983399 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2e00a8fd-cea1-4461-b83b-e0e05754e3cf tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1450 microversion: 2.1 time: 0.161956 Oct 04 09:02:58.984216 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 527/1104] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:58 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:01.774821 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-8c1bb56d-1339-4a6d-8ca7-fb349cb06b29 req-e78f5909-c951-4dc8-b54c-e08556cf9aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f473325-1877-43e1-8150-90eeadbdd17a", "tag": "e3ff2094-e984-4eea-ac2f-ef4e15fcfe78"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:03:01.786354 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-8c1bb56d-1339-4a6d-8ca7-fb349cb06b29 req-e78f5909-c951-4dc8-b54c-e08556cf9aa6 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:01.787067 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-8c1bb56d-1339-4a6d-8ca7-fb349cb06b29 req-e78f5909-c951-4dc8-b54c-e08556cf9aa6 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:01.787743 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-8c1bb56d-1339-4a6d-8ca7-fb349cb06b29 req-e78f5909-c951-4dc8-b54c-e08556cf9aa6 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:01.804086 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-8c1bb56d-1339-4a6d-8ca7-fb349cb06b29 req-e78f5909-c951-4dc8-b54c-e08556cf9aa6 service nova] Creating event network-changed:e3ff2094-e984-4eea-ac2f-ef4e15fcfe78 for instance 4f473325-1877-43e1-8150-90eeadbdd17a on hv-cinder-84456 Oct 04 09:03:01.814214 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-8c1bb56d-1339-4a6d-8ca7-fb349cb06b29 req-e78f5909-c951-4dc8-b54c-e08556cf9aa6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043164 Oct 04 09:03:01.815677 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 578/1105] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:04.342546 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6c2b3594-df46-47ee-a467-c9eb74b38f24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:04.345964 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6c2b3594-df46-47ee-a467-c9eb74b38f24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:04.352135 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:04.354502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c2b3594-df46-47ee-a467-c9eb74b38f24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:04.355261 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c2b3594-df46-47ee-a467-c9eb74b38f24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:04.355963 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c2b3594-df46-47ee-a467-c9eb74b38f24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:04.356873 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c2b3594-df46-47ee-a467-c9eb74b38f24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:04.357331 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c2b3594-df46-47ee-a467-c9eb74b38f24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:04.357755 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6c2b3594-df46-47ee-a467-c9eb74b38f24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:04.389348 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6c2b3594-df46-47ee-a467-c9eb74b38f24 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051885 Oct 04 09:03:04.390052 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 528/1106] 10.222.0.44 () {60 vars in 1343 bytes} [Tue Oct 4 09:03:04 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:04.457945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a53681f5-b197-47c9-8993-84bdb576c918 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:04.459162 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a53681f5-b197-47c9-8993-84bdb576c918 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:04.465361 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a53681f5-b197-47c9-8993-84bdb576c918 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:04.465825 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a53681f5-b197-47c9-8993-84bdb576c918 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:04.466255 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a53681f5-b197-47c9-8993-84bdb576c918 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:04.466976 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a53681f5-b197-47c9-8993-84bdb576c918 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:04.467426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a53681f5-b197-47c9-8993-84bdb576c918 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:04.468372 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a53681f5-b197-47c9-8993-84bdb576c918 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:04.496053 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a53681f5-b197-47c9-8993-84bdb576c918 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Going to try to terminate instance {{(pid=142438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:03:04.589550 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a53681f5-b197-47c9-8993-84bdb576c918 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "DELETE /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 204 len: 0 microversion: 2.20 time: 0.136019 Oct 04 09:03:04.590158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 579/1107] 10.222.0.44 () {60 vars in 1280 bytes} [Tue Oct 4 09:03:04 2022] DELETE /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 09:03:04.600362 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-46211872-c119-4108-a7cd-771de68776da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:04.601062 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-46211872-c119-4108-a7cd-771de68776da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:04.607050 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-46211872-c119-4108-a7cd-771de68776da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:04.607525 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-46211872-c119-4108-a7cd-771de68776da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:04.607979 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-46211872-c119-4108-a7cd-771de68776da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:04.608696 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-46211872-c119-4108-a7cd-771de68776da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:04.609139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-46211872-c119-4108-a7cd-771de68776da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:04.609757 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-46211872-c119-4108-a7cd-771de68776da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:04.844081 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-46211872-c119-4108-a7cd-771de68776da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:04.852446 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-46211872-c119-4108-a7cd-771de68776da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:04.853890 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-46211872-c119-4108-a7cd-771de68776da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:04.855060 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-46211872-c119-4108-a7cd-771de68776da tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.260110 Oct 04 09:03:04.855620 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 529/1108] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:03:04 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:03:05.883948 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c4217dfb-c87b-4c1a-9a33-f3aa06a06ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:05.884665 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c4217dfb-c87b-4c1a-9a33-f3aa06a06ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:05.893116 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c4217dfb-c87b-4c1a-9a33-f3aa06a06ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:05.893853 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c4217dfb-c87b-4c1a-9a33-f3aa06a06ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:05.894458 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c4217dfb-c87b-4c1a-9a33-f3aa06a06ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:05.895328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c4217dfb-c87b-4c1a-9a33-f3aa06a06ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:05.896276 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c4217dfb-c87b-4c1a-9a33-f3aa06a06ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:05.896881 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c4217dfb-c87b-4c1a-9a33-f3aa06a06ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:06.060901 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c4217dfb-c87b-4c1a-9a33-f3aa06a06ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:06.071617 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c4217dfb-c87b-4c1a-9a33-f3aa06a06ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:06.073349 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c4217dfb-c87b-4c1a-9a33-f3aa06a06ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:06.075300 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c4217dfb-c87b-4c1a-9a33-f3aa06a06ed5 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.197305 Oct 04 09:03:06.076522 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 580/1109] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:03:05 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:03:07.102741 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c064ebbe-987a-4f25-82f8-355e1c4f3b68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:07.104250 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c064ebbe-987a-4f25-82f8-355e1c4f3b68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:07.112537 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c064ebbe-987a-4f25-82f8-355e1c4f3b68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:07.113287 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c064ebbe-987a-4f25-82f8-355e1c4f3b68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:07.114096 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c064ebbe-987a-4f25-82f8-355e1c4f3b68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:07.115019 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c064ebbe-987a-4f25-82f8-355e1c4f3b68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:07.115683 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c064ebbe-987a-4f25-82f8-355e1c4f3b68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:07.116339 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c064ebbe-987a-4f25-82f8-355e1c4f3b68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:07.604476 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-5da7f83b-1a78-448c-972d-6b71d1495d88 req-c7c90193-a16e-48ed-baa5-3e3a083625cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92654e2b-1d8a-4564-8a00-e659b6ae6ec9", "name": "network-vif-deleted", "tag": "f2362281-c90c-4e3f-bb88-2c03bca5bd71"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:03:07.631504 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-5da7f83b-1a78-448c-972d-6b71d1495d88 req-c7c90193-a16e-48ed-baa5-3e3a083625cf service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:07.636590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-5da7f83b-1a78-448c-972d-6b71d1495d88 req-c7c90193-a16e-48ed-baa5-3e3a083625cf service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:07.637319 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-5da7f83b-1a78-448c-972d-6b71d1495d88 req-c7c90193-a16e-48ed-baa5-3e3a083625cf service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:07.642600 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c064ebbe-987a-4f25-82f8-355e1c4f3b68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:07.669502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c064ebbe-987a-4f25-82f8-355e1c4f3b68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:07.671387 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c064ebbe-987a-4f25-82f8-355e1c4f3b68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68288f4e2f57454fbb06eff0dd72cca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255b03b31004c3b8e446f318cd72265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:07.672949 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c064ebbe-987a-4f25-82f8-355e1c4f3b68 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 200 len: 1722 microversion: 2.20 time: 0.574733 Oct 04 09:03:07.688150 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-5da7f83b-1a78-448c-972d-6b71d1495d88 req-c7c90193-a16e-48ed-baa5-3e3a083625cf service nova] Creating event network-vif-deleted:f2362281-c90c-4e3f-bb88-2c03bca5bd71 for instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 on hv-cinder-84456 Oct 04 09:03:07.689139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 530/1110] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:03:07 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 1722 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 09:03:07.709011 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-5da7f83b-1a78-448c-972d-6b71d1495d88 req-c7c90193-a16e-48ed-baa5-3e3a083625cf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108809 Oct 04 09:03:07.710210 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 581/1111] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:08.700276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e33ca75a-c29e-478c-ad27-44b87101840d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:08.701512 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e33ca75a-c29e-478c-ad27-44b87101840d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:08.710295 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e33ca75a-c29e-478c-ad27-44b87101840d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:08.710791 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e33ca75a-c29e-478c-ad27-44b87101840d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:08.711227 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e33ca75a-c29e-478c-ad27-44b87101840d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:08.711973 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e33ca75a-c29e-478c-ad27-44b87101840d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:08.722730 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e33ca75a-c29e-478c-ad27-44b87101840d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:08.723715 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e33ca75a-c29e-478c-ad27-44b87101840d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:08.750213 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-e33ca75a-c29e-478c-ad27-44b87101840d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] HTTP exception thrown: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e33ca75a-c29e-478c-ad27-44b87101840d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Request method failure captured: Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 HTTP/1.1 Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_QicjPpnyO013RuvkG92z1S22OX7H2md5ngYNnXz3ZPNd5NdIokT1HjZPVfLGEqDdJv6yEKaccbr7o56oa_UUEoFW5frrn-m21DZpmA2K1poYeLETAHGlJFoGhJhe-w6DW2EY21A8faNXuseAT8P7uYYKfFNUfe2IzlIT8KKs2LGxU Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: d255b03b31004c3b8e446f318cd72265 Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:03:08.751865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:03:08.754023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d255b03b31004c3b8e446f318cd72265", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:03:08.754023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 09:03:08.754023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: d255b03b31004c3b8e446f318cd72265 Oct 04 09:03:08.754023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 09:03:08.754023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-AttachVolumeShelveTestJSON-567630336-project Oct 04 09:03:08.754023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:03:08.754023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:03:08.754023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 68288f4e2f57454fbb06eff0dd72cca3 Oct 04 09:03:08.754023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-AttachVolumeShelveTestJSON-567630336-project Oct 04 09:03:08.754023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:03:08.754023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. Oct 04 09:03:08.754023 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': '92654e2b-1d8a-4564-8a00-e659b6ae6ec9'} Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:03:08.754837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. Oct 04 09:03:08.756105 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:08.757277 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e33ca75a-c29e-478c-ad27-44b87101840d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Returning 404 to user: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:03:08.757277 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e33ca75a-c29e-478c-ad27-44b87101840d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 404 len: 111 microversion: 2.20 time: 0.057168 Oct 04 09:03:08.758935 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 531/1112] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:03:08 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 09:03:08.765010 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c03e8228-4a79-465e-ade0-b3867ee4e8ea tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '.version_select at 0x7ff92e560310>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:08.799293 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c03e8228-4a79-465e-ade0-b3867ee4e8ea tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-654476180" status: 204 len: 0 microversion: 2.20 time: 0.039223 Oct 04 09:03:08.800338 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 582/1113] 10.222.0.44 () {60 vars in 1259 bytes} [Tue Oct 4 09:03:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-654476180 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 09:03:09.263858 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-103d435c-9d3a-4429-992a-a5eb148578f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Action: 'create', calling method: .version_select at 0x7ff92e31d1f0>, body: {"keypair": {"name": "tempest-keypair-747555053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0wX+MASxGR4993GQK+jJLPRCg/QR94cZU9toWlBxADxYKBixxSj8/uyE1Ddc7Q+arHxmJ3a6DFDtwz/0v8SJ7XK2bI+jMuKhoKfJjUF+CWzAMRDdbvswOqEZAPR2BmDg=="}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:03:09.279768 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-103d435c-9d3a-4429-992a-a5eb148578f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:03:09.284699 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-103d435c-9d3a-4429-992a-a5eb148578f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for user 3ec88da1704d44fb924fa3cc04e5fe25 and project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:03:09.298292 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR oslo.messaging._drivers.impl_rabbit [None req-103d435c-9d3a-4429-992a-a5eb148578f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [16d2a5bf-7b60-4018-a649-6b57f12e6c6f] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 09:03:10.306916 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO oslo.messaging._drivers.impl_rabbit [None req-103d435c-9d3a-4429-992a-a5eb148578f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [16d2a5bf-7b60-4018-a649-6b57f12e6c6f] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 49732. Oct 04 09:03:10.324273 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-103d435c-9d3a-4429-992a-a5eb148578f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.199927 Oct 04 09:03:10.324873 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 532/1114] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Oct 4 09:03:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:10.682160 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9a8b6fea-9739-49ec-8608-9594749f7489 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:10.682791 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9a8b6fea-9739-49ec-8608-9594749f7489 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:10.695815 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9a8b6fea-9739-49ec-8608-9594749f7489 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:10.696569 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9a8b6fea-9739-49ec-8608-9594749f7489 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:10.697770 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9a8b6fea-9739-49ec-8608-9594749f7489 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:10.698499 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9a8b6fea-9739-49ec-8608-9594749f7489 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:10.698955 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9a8b6fea-9739-49ec-8608-9594749f7489 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:10.699379 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9a8b6fea-9739-49ec-8608-9594749f7489 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:10.714265 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-9a8b6fea-9739-49ec-8608-9594749f7489 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] HTTP exception thrown: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9a8b6fea-9739-49ec-8608-9594749f7489 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Request method failure captured: Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: DELETE /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 HTTP/1.1 Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_QicjPpnyO013RuvkG92z1S22OX7H2md5ngYNnXz3ZPNd5NdIokT1HjZPVfLGEqDdJv6yEKaccbr7o56oa_UUEoFW5frrn-m21DZpmA2K1poYeLETAHGlJFoGhJhe-w6DW2EY21A8faNXuseAT8P7uYYKfFNUfe2IzlIT8KKs2LGxU Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: d255b03b31004c3b8e446f318cd72265 Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:03:10.716247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:03:10.717774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d255b03b31004c3b8e446f318cd72265", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:03:10.717774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 09:03:10.717774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: d255b03b31004c3b8e446f318cd72265 Oct 04 09:03:10.717774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 09:03:10.717774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-AttachVolumeShelveTestJSON-567630336-project Oct 04 09:03:10.717774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:03:10.717774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:03:10.717774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 68288f4e2f57454fbb06eff0dd72cca3 Oct 04 09:03:10.717774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-AttachVolumeShelveTestJSON-567630336-project Oct 04 09:03:10.717774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:03:10.717774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. Oct 04 09:03:10.717774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': '92654e2b-1d8a-4564-8a00-e659b6ae6ec9'} Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:03:10.718540 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. Oct 04 09:03:10.720678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:03:10.723284 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9a8b6fea-9739-49ec-8608-9594749f7489 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Returning 404 to user: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:03:10.723284 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-9a8b6fea-9739-49ec-8608-9594749f7489 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "DELETE /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 404 len: 111 microversion: 2.20 time: 0.041454 Oct 04 09:03:10.723284 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 583/1115] 10.222.0.44 () {60 vars in 1280 bytes} [Tue Oct 4 09:03:10 2022] DELETE /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 09:03:10.727811 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f41ea244-2b4b-4898-8894-89f7b6a6dc0d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:10.728770 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f41ea244-2b4b-4898-8894-89f7b6a6dc0d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: 92654e2b-1d8a-4564-8a00-e659b6ae6ec9] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:10.741187 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f41ea244-2b4b-4898-8894-89f7b6a6dc0d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:10.741946 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f41ea244-2b4b-4898-8894-89f7b6a6dc0d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:10.742787 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f41ea244-2b4b-4898-8894-89f7b6a6dc0d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:10.744174 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f41ea244-2b4b-4898-8894-89f7b6a6dc0d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:10.744673 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f41ea244-2b4b-4898-8894-89f7b6a6dc0d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:10.745256 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f41ea244-2b4b-4898-8894-89f7b6a6dc0d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:10.761179 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-f41ea244-2b4b-4898-8894-89f7b6a6dc0d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] HTTP exception thrown: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f41ea244-2b4b-4898-8894-89f7b6a6dc0d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Request method failure captured: Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 HTTP/1.1 Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_QicjPpnyO013RuvkG92z1S22OX7H2md5ngYNnXz3ZPNd5NdIokT1HjZPVfLGEqDdJv6yEKaccbr7o56oa_UUEoFW5frrn-m21DZpmA2K1poYeLETAHGlJFoGhJhe-w6DW2EY21A8faNXuseAT8P7uYYKfFNUfe2IzlIT8KKs2LGxU Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: d255b03b31004c3b8e446f318cd72265 Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:03:10.763139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:03:10.764750 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d255b03b31004c3b8e446f318cd72265", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:03:10.764750 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 09:03:10.764750 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: d255b03b31004c3b8e446f318cd72265 Oct 04 09:03:10.764750 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 09:03:10.764750 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-AttachVolumeShelveTestJSON-567630336-project Oct 04 09:03:10.764750 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:03:10.764750 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:03:10.764750 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 68288f4e2f57454fbb06eff0dd72cca3 Oct 04 09:03:10.764750 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-AttachVolumeShelveTestJSON-567630336-project Oct 04 09:03:10.764750 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:03:10.764750 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. Oct 04 09:03:10.764750 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': '92654e2b-1d8a-4564-8a00-e659b6ae6ec9'} Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:03:10.765501 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. Oct 04 09:03:10.766760 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:10.769497 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f41ea244-2b4b-4898-8894-89f7b6a6dc0d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Returning 404 to user: Instance 92654e2b-1d8a-4564-8a00-e659b6ae6ec9 could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:03:10.770490 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f41ea244-2b4b-4898-8894-89f7b6a6dc0d tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9" status: 404 len: 111 microversion: 2.20 time: 0.047158 Oct 04 09:03:10.771601 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 533/1116] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:03:10 2022] GET /compute/v2.1/servers/92654e2b-1d8a-4564-8a00-e659b6ae6ec9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 09:03:11.656392 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-161098462", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20cff610-f8c7-446f-a4a5-54f1f06f39ee"}], "security_groups": [{"name": "tempest-securitygroup--1580364156"}], "key_name": "tempest-keypair-747555053", "user_data": "}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:03:11.773167 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.network.neutron [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] validate_networks() for [('20cff610-f8c7-446f-a4a5-54f1f06f39ee', None, None, None, None, None)] {{(pid=142438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:03:11.940088 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9a821b1c-dc93-4aa3-a5e1-4bdb592488c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:11.941288 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9a821b1c-dc93-4aa3-a5e1-4bdb592488c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:11.948644 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a821b1c-dc93-4aa3-a5e1-4bdb592488c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:11.949398 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a821b1c-dc93-4aa3-a5e1-4bdb592488c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:11.950286 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a821b1c-dc93-4aa3-a5e1-4bdb592488c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:11.951208 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a821b1c-dc93-4aa3-a5e1-4bdb592488c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:11.951811 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a821b1c-dc93-4aa3-a5e1-4bdb592488c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:11.952485 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a821b1c-dc93-4aa3-a5e1-4bdb592488c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:11.974416 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-9a821b1c-dc93-4aa3-a5e1-4bdb592488c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] HTTP exception thrown: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9a821b1c-dc93-4aa3-a5e1-4bdb592488c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Request method failure captured: Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: DELETE /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed HTTP/1.1 Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_QicjPpnyO013RuvkG92z1S22OX7H2md5ngYNnXz3ZPNd5NdIokT1HjZPVfLGEqDdJv6yEKaccbr7o56oa_UUEoFW5frrn-m21DZpmA2K1poYeLETAHGlJFoGhJhe-w6DW2EY21A8faNXuseAT8P7uYYKfFNUfe2IzlIT8KKs2LGxU Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: d255b03b31004c3b8e446f318cd72265 Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:03:11.976209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:03:11.977614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d255b03b31004c3b8e446f318cd72265", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:03:11.977614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 09:03:11.977614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: d255b03b31004c3b8e446f318cd72265 Oct 04 09:03:11.977614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 09:03:11.977614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-AttachVolumeShelveTestJSON-567630336-project Oct 04 09:03:11.977614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:03:11.977614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:03:11.977614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 68288f4e2f57454fbb06eff0dd72cca3 Oct 04 09:03:11.977614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-AttachVolumeShelveTestJSON-567630336-project Oct 04 09:03:11.977614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:03:11.977614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. Oct 04 09:03:11.977614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': 'f4454abc-67a9-470b-bdce-5a69bc51bbed'} Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:03:11.978392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. Oct 04 09:03:11.979631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:11.980990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9a821b1c-dc93-4aa3-a5e1-4bdb592488c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Returning 404 to user: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:03:11.980990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9a821b1c-dc93-4aa3-a5e1-4bdb592488c0 tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 404 len: 111 microversion: 2.20 time: 0.041938 Oct 04 09:03:11.983980 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 534/1117] 10.222.0.44 () {60 vars in 1280 bytes} [Tue Oct 4 09:03:11 2022] DELETE /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 09:03:11.989170 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f8b523d6-82d9-4083-a1c0-a07888b8443f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:11.990061 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f8b523d6-82d9-4083-a1c0-a07888b8443f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] [instance: f4454abc-67a9-470b-bdce-5a69bc51bbed] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:12.001677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f8b523d6-82d9-4083-a1c0-a07888b8443f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:12.002648 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f8b523d6-82d9-4083-a1c0-a07888b8443f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:12.003334 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f8b523d6-82d9-4083-a1c0-a07888b8443f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:12.004337 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f8b523d6-82d9-4083-a1c0-a07888b8443f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:12.005029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f8b523d6-82d9-4083-a1c0-a07888b8443f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:12.005674 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f8b523d6-82d9-4083-a1c0-a07888b8443f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:12.021489 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-f8b523d6-82d9-4083-a1c0-a07888b8443f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] HTTP exception thrown: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f8b523d6-82d9-4083-a1c0-a07888b8443f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Request method failure captured: Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed HTTP/1.1 Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_QicjPpnyO013RuvkG92z1S22OX7H2md5ngYNnXz3ZPNd5NdIokT1HjZPVfLGEqDdJv6yEKaccbr7o56oa_UUEoFW5frrn-m21DZpmA2K1poYeLETAHGlJFoGhJhe-w6DW2EY21A8faNXuseAT8P7uYYKfFNUfe2IzlIT8KKs2LGxU Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: d255b03b31004c3b8e446f318cd72265 Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:03:12.024886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:03:12.026418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d255b03b31004c3b8e446f318cd72265", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d255b03b31004c3b8e446f318cd72265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:03:12.026418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 09:03:12.026418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: d255b03b31004c3b8e446f318cd72265 Oct 04 09:03:12.026418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-567630336 Oct 04 09:03:12.026418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-AttachVolumeShelveTestJSON-567630336-project Oct 04 09:03:12.026418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:03:12.026418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:03:12.026418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 68288f4e2f57454fbb06eff0dd72cca3 Oct 04 09:03:12.026418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-AttachVolumeShelveTestJSON-567630336-project Oct 04 09:03:12.026418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:03:12.026418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. Oct 04 09:03:12.026418 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': 'f4454abc-67a9-470b-bdce-5a69bc51bbed'} Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:03:12.027583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. Oct 04 09:03:12.029107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:03:12.030666 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f8b523d6-82d9-4083-a1c0-a07888b8443f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] Returning 404 to user: Instance f4454abc-67a9-470b-bdce-5a69bc51bbed could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:03:12.030666 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f8b523d6-82d9-4083-a1c0-a07888b8443f tempest-AttachVolumeShelveTestJSON-567630336 tempest-AttachVolumeShelveTestJSON-567630336-project] 10.222.0.44 "GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed" status: 404 len: 111 microversion: 2.20 time: 0.040942 Oct 04 09:03:12.030666 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 535/1118] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Oct 4 09:03:11 2022] GET /compute/v2.1/servers/f4454abc-67a9-470b-bdce-5a69bc51bbed => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 09:03:12.226759 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Flavor limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:03:12.227301 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Image limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:03:12.227866 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Flavor pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:03:12.228418 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Image pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:03:12.228929 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:03:12.243208 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:12.244182 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:12.244826 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:12.245926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:12.246436 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:12.246869 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:12.267304 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:03:12.273036 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for user 3ec88da1704d44fb924fa3cc04e5fe25 and project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:03:12.293251 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Going to run 1 instances... {{(pid=142438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:03:12.295584 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:03:12.353181 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-cf30bc37-ff2f-4c40-82ff-0a30922e5517 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.702126 Oct 04 09:03:12.354142 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 584/1119] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 09:03:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 09:03:12.369594 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ee1b34fd-b054-4892-9733-04f6f1a71847 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:12.370902 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ee1b34fd-b054-4892-9733-04f6f1a71847 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:12.458625 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ee1b34fd-b054-4892-9733-04f6f1a71847 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:12.473324 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ee1b34fd-b054-4892-9733-04f6f1a71847 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 200 len: 1240 microversion: 2.1 time: 0.111888 Oct 04 09:03:12.475063 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 536/1120] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:12 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 1240 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:13.497064 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b040392f-35f0-43b4-a6a4-000513a5ac0e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:13.497626 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b040392f-35f0-43b4-a6a4-000513a5ac0e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:13.504663 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b040392f-35f0-43b4-a6a4-000513a5ac0e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:13.505156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b040392f-35f0-43b4-a6a4-000513a5ac0e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:13.505596 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b040392f-35f0-43b4-a6a4-000513a5ac0e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:13.506307 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b040392f-35f0-43b4-a6a4-000513a5ac0e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:13.506764 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b040392f-35f0-43b4-a6a4-000513a5ac0e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:13.507198 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b040392f-35f0-43b4-a6a4-000513a5ac0e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:13.574795 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b040392f-35f0-43b4-a6a4-000513a5ac0e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:13.583995 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b040392f-35f0-43b4-a6a4-000513a5ac0e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 200 len: 1292 microversion: 2.1 time: 0.091691 Oct 04 09:03:13.584673 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 585/1121] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:13 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:14.607019 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2ab7cd45-f8db-4952-a6e4-c67130962f39 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:14.607633 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2ab7cd45-f8db-4952-a6e4-c67130962f39 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:14.616144 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ab7cd45-f8db-4952-a6e4-c67130962f39 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:14.616966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ab7cd45-f8db-4952-a6e4-c67130962f39 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:14.618003 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ab7cd45-f8db-4952-a6e4-c67130962f39 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:14.619117 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ab7cd45-f8db-4952-a6e4-c67130962f39 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:14.619732 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ab7cd45-f8db-4952-a6e4-c67130962f39 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:14.620544 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ab7cd45-f8db-4952-a6e4-c67130962f39 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:15.014757 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2ab7cd45-f8db-4952-a6e4-c67130962f39 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:15.023184 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2ab7cd45-f8db-4952-a6e4-c67130962f39 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 200 len: 1366 microversion: 2.1 time: 0.419946 Oct 04 09:03:15.023909 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 537/1122] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:14 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 1366 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:15.624257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-9a1243b7-471a-4704-9c0f-6b5a1d37b7ad req-6953b095-4c7b-405c-8869-8c55f7be2cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "234fb5e1-513f-4c6e-bce8-43580ed70303", "tag": "846bf3ba-d84e-4e4b-808c-b00a72468afa"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:03:15.639932 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-9a1243b7-471a-4704-9c0f-6b5a1d37b7ad req-6953b095-4c7b-405c-8869-8c55f7be2cf6 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:15.640453 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-9a1243b7-471a-4704-9c0f-6b5a1d37b7ad req-6953b095-4c7b-405c-8869-8c55f7be2cf6 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:15.640895 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-9a1243b7-471a-4704-9c0f-6b5a1d37b7ad req-6953b095-4c7b-405c-8869-8c55f7be2cf6 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:15.653759 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-9a1243b7-471a-4704-9c0f-6b5a1d37b7ad req-6953b095-4c7b-405c-8869-8c55f7be2cf6 service nova] Creating event network-changed:846bf3ba-d84e-4e4b-808c-b00a72468afa for instance 234fb5e1-513f-4c6e-bce8-43580ed70303 on hv-cinder-84456 Oct 04 09:03:15.658814 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-9a1243b7-471a-4704-9c0f-6b5a1d37b7ad req-6953b095-4c7b-405c-8869-8c55f7be2cf6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041459 Oct 04 09:03:15.659542 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 586/1123] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:16.049441 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-12d18768-f822-41e4-8c60-ddf55517f01c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:16.050123 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-12d18768-f822-41e4-8c60-ddf55517f01c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:16.059212 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12d18768-f822-41e4-8c60-ddf55517f01c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:16.060000 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12d18768-f822-41e4-8c60-ddf55517f01c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:16.060837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12d18768-f822-41e4-8c60-ddf55517f01c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:16.061883 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12d18768-f822-41e4-8c60-ddf55517f01c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:16.062570 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12d18768-f822-41e4-8c60-ddf55517f01c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:16.063212 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-12d18768-f822-41e4-8c60-ddf55517f01c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:16.224903 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-12d18768-f822-41e4-8c60-ddf55517f01c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:16.232836 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-12d18768-f822-41e4-8c60-ddf55517f01c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 200 len: 1366 microversion: 2.1 time: 0.189545 Oct 04 09:03:16.233655 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 538/1124] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:16 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:17.259810 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-bc4fc2c7-7659-43e3-9388-f3098a46b385 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:17.260668 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-bc4fc2c7-7659-43e3-9388-f3098a46b385 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:17.266978 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc4fc2c7-7659-43e3-9388-f3098a46b385 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:17.267596 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc4fc2c7-7659-43e3-9388-f3098a46b385 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:17.268101 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc4fc2c7-7659-43e3-9388-f3098a46b385 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:17.268798 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc4fc2c7-7659-43e3-9388-f3098a46b385 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:17.269235 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc4fc2c7-7659-43e3-9388-f3098a46b385 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:17.269635 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc4fc2c7-7659-43e3-9388-f3098a46b385 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:17.401350 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-bc4fc2c7-7659-43e3-9388-f3098a46b385 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:17.409045 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-bc4fc2c7-7659-43e3-9388-f3098a46b385 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 200 len: 1366 microversion: 2.1 time: 0.154201 Oct 04 09:03:17.409767 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 587/1125] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:17 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:18.430867 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e8a9d9ca-f521-4fb6-8b00-079bc139124c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:18.431672 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e8a9d9ca-f521-4fb6-8b00-079bc139124c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:18.439381 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e8a9d9ca-f521-4fb6-8b00-079bc139124c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:18.440171 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e8a9d9ca-f521-4fb6-8b00-079bc139124c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:18.441099 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e8a9d9ca-f521-4fb6-8b00-079bc139124c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:18.441794 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e8a9d9ca-f521-4fb6-8b00-079bc139124c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:18.442258 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e8a9d9ca-f521-4fb6-8b00-079bc139124c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:18.444093 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e8a9d9ca-f521-4fb6-8b00-079bc139124c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:18.582631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e8a9d9ca-f521-4fb6-8b00-079bc139124c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:18.590451 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e8a9d9ca-f521-4fb6-8b00-079bc139124c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 200 len: 1366 microversion: 2.1 time: 0.163532 Oct 04 09:03:18.591011 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 539/1126] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:18 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:19.613352 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1bff0b1f-49f9-4a8b-ac61-87f045ad483d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:19.614091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1bff0b1f-49f9-4a8b-ac61-87f045ad483d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:19.621352 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1bff0b1f-49f9-4a8b-ac61-87f045ad483d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:19.621875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1bff0b1f-49f9-4a8b-ac61-87f045ad483d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:19.622327 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1bff0b1f-49f9-4a8b-ac61-87f045ad483d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:19.623080 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1bff0b1f-49f9-4a8b-ac61-87f045ad483d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:19.623613 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1bff0b1f-49f9-4a8b-ac61-87f045ad483d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:19.625362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1bff0b1f-49f9-4a8b-ac61-87f045ad483d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:19.793492 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1bff0b1f-49f9-4a8b-ac61-87f045ad483d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:19.801726 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1bff0b1f-49f9-4a8b-ac61-87f045ad483d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 200 len: 1366 microversion: 2.1 time: 0.192355 Oct 04 09:03:19.802304 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 588/1127] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:19 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:20.824164 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-7af2b466-2bea-47fb-a72f-53db9089dbd0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:20.824787 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-7af2b466-2bea-47fb-a72f-53db9089dbd0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:20.834335 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7af2b466-2bea-47fb-a72f-53db9089dbd0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:20.834825 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7af2b466-2bea-47fb-a72f-53db9089dbd0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:20.835256 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7af2b466-2bea-47fb-a72f-53db9089dbd0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:20.835994 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7af2b466-2bea-47fb-a72f-53db9089dbd0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:20.836483 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7af2b466-2bea-47fb-a72f-53db9089dbd0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:20.836904 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7af2b466-2bea-47fb-a72f-53db9089dbd0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:20.973949 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-7af2b466-2bea-47fb-a72f-53db9089dbd0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:20.981924 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-7af2b466-2bea-47fb-a72f-53db9089dbd0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 200 len: 1366 microversion: 2.1 time: 0.161612 Oct 04 09:03:20.988611 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 540/1128] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:20 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:22.004781 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8d65e659-247c-45bd-9e08-91b427b0f68a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:22.005522 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8d65e659-247c-45bd-9e08-91b427b0f68a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:22.012135 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8d65e659-247c-45bd-9e08-91b427b0f68a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:22.012720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8d65e659-247c-45bd-9e08-91b427b0f68a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:22.013045 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8d65e659-247c-45bd-9e08-91b427b0f68a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:22.013746 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8d65e659-247c-45bd-9e08-91b427b0f68a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:22.014416 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8d65e659-247c-45bd-9e08-91b427b0f68a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:22.014841 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8d65e659-247c-45bd-9e08-91b427b0f68a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:22.074761 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-041a8bb0-9401-4007-a6cb-8d05d15f032e req-d65b1897-e18c-4039-9928-50a233ccd3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "234fb5e1-513f-4c6e-bce8-43580ed70303", "name": "network-vif-plugged", "status": "completed", "tag": "846bf3ba-d84e-4e4b-808c-b00a72468afa"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:03:22.086262 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-041a8bb0-9401-4007-a6cb-8d05d15f032e req-d65b1897-e18c-4039-9928-50a233ccd3b5 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:22.087671 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-041a8bb0-9401-4007-a6cb-8d05d15f032e req-d65b1897-e18c-4039-9928-50a233ccd3b5 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:22.089245 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-041a8bb0-9401-4007-a6cb-8d05d15f032e req-d65b1897-e18c-4039-9928-50a233ccd3b5 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:22.104217 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-041a8bb0-9401-4007-a6cb-8d05d15f032e req-d65b1897-e18c-4039-9928-50a233ccd3b5 service nova] Creating event network-vif-plugged:846bf3ba-d84e-4e4b-808c-b00a72468afa for instance 234fb5e1-513f-4c6e-bce8-43580ed70303 on hv-cinder-84456 Oct 04 09:03:22.113210 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-041a8bb0-9401-4007-a6cb-8d05d15f032e req-d65b1897-e18c-4039-9928-50a233ccd3b5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039778 Oct 04 09:03:22.114320 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 541/1129] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:22.179782 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8d65e659-247c-45bd-9e08-91b427b0f68a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:22.189612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8d65e659-247c-45bd-9e08-91b427b0f68a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 200 len: 1366 microversion: 2.1 time: 0.188906 Oct 04 09:03:22.190204 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 589/1130] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:21 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:03:23.213187 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-3540a1b5-12d7-4c94-9f21-606800db8669 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:23.213903 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-3540a1b5-12d7-4c94-9f21-606800db8669 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:23.215852 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=6 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:23.221919 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3540a1b5-12d7-4c94-9f21-606800db8669 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:23.222448 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3540a1b5-12d7-4c94-9f21-606800db8669 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:23.222819 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3540a1b5-12d7-4c94-9f21-606800db8669 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:23.223505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3540a1b5-12d7-4c94-9f21-606800db8669 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:23.223974 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3540a1b5-12d7-4c94-9f21-606800db8669 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:23.224392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-3540a1b5-12d7-4c94-9f21-606800db8669 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:23.354862 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-3540a1b5-12d7-4c94-9f21-606800db8669 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:23.363110 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-3540a1b5-12d7-4c94-9f21-606800db8669 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 200 len: 1366 microversion: 2.1 time: 0.154529 Oct 04 09:03:23.363691 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 542/1131] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:23 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:24.390773 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b9d48a9f-d42b-47a2-ac35-3d911560b690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:24.391400 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b9d48a9f-d42b-47a2-ac35-3d911560b690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:24.393431 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:24.394189 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=6 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:24.395614 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:24.402357 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9d48a9f-d42b-47a2-ac35-3d911560b690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:24.402837 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9d48a9f-d42b-47a2-ac35-3d911560b690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:24.403288 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9d48a9f-d42b-47a2-ac35-3d911560b690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:24.404019 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9d48a9f-d42b-47a2-ac35-3d911560b690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:24.404474 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9d48a9f-d42b-47a2-ac35-3d911560b690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:24.404890 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9d48a9f-d42b-47a2-ac35-3d911560b690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:24.410679 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:24.544075 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b9d48a9f-d42b-47a2-ac35-3d911560b690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:24.552335 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b9d48a9f-d42b-47a2-ac35-3d911560b690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 200 len: 1557 microversion: 2.1 time: 0.165552 Oct 04 09:03:24.552911 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 590/1132] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:24 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:24.574769 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-65215ba4-5b1a-48a1-b8fd-f2e5cb9c128e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:24.575290 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-65215ba4-5b1a-48a1-b8fd-f2e5cb9c128e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:24.581819 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-65215ba4-5b1a-48a1-b8fd-f2e5cb9c128e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:24.582307 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-65215ba4-5b1a-48a1-b8fd-f2e5cb9c128e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:24.582742 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-65215ba4-5b1a-48a1-b8fd-f2e5cb9c128e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:24.583435 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-65215ba4-5b1a-48a1-b8fd-f2e5cb9c128e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:24.583904 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-65215ba4-5b1a-48a1-b8fd-f2e5cb9c128e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:24.584345 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-65215ba4-5b1a-48a1-b8fd-f2e5cb9c128e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:24.587955 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=95 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:24.664470 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-65215ba4-5b1a-48a1-b8fd-f2e5cb9c128e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093503 Oct 04 09:03:24.665073 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 543/1133] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Oct 4 09:03:24 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:25.884262 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-5977ce23-93e5-4981-a005-ee1a32f4b7d8 req-0feedf09-f27d-4372-8691-7e64d9446f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "234fb5e1-513f-4c6e-bce8-43580ed70303", "tag": "846bf3ba-d84e-4e4b-808c-b00a72468afa"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:03:25.894423 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-5977ce23-93e5-4981-a005-ee1a32f4b7d8 req-0feedf09-f27d-4372-8691-7e64d9446f28 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:25.894902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-5977ce23-93e5-4981-a005-ee1a32f4b7d8 req-0feedf09-f27d-4372-8691-7e64d9446f28 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:25.895328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-5977ce23-93e5-4981-a005-ee1a32f4b7d8 req-0feedf09-f27d-4372-8691-7e64d9446f28 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:25.907386 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-5977ce23-93e5-4981-a005-ee1a32f4b7d8 req-0feedf09-f27d-4372-8691-7e64d9446f28 service nova] Creating event network-changed:846bf3ba-d84e-4e4b-808c-b00a72468afa for instance 234fb5e1-513f-4c6e-bce8-43580ed70303 on hv-cinder-84456 Oct 04 09:03:25.912527 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-5977ce23-93e5-4981-a005-ee1a32f4b7d8 req-0feedf09-f27d-4372-8691-7e64d9446f28 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031930 Oct 04 09:03:25.913464 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 591/1134] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:07.360003 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:07.360745 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=3 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:07.362051 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 09:04:07.362214 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Tue Oct 4 09:04:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.44) !!! Oct 04 09:04:07.548413 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f28efe75-45ff-4c27-90b7-3025a3177204 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Action: 'create', calling method: .version_select at 0x7ff92e31d310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1659556079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFCEZWhbwFbJgNVd0CoB8YbakTe5qfgUBiV2ephFSuab1VFIHkKL/Fm1eCnBmB4AVwT5yyT6bi9//PSQ6Boc/87KOaJ4o73N6BZIc1Q4W2T/b3gdJcnRYF/eS1o6gjYEA=="}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:07.566053 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-f28efe75-45ff-4c27-90b7-3025a3177204 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Getting quotas for project 1c3592efc4ea4562a7b38a9189c7d04f. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:04:07.570498 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-f28efe75-45ff-4c27-90b7-3025a3177204 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Getting quotas for user 6cfec539e6dc404fa692139310733d31 and project 1c3592efc4ea4562a7b38a9189c7d04f. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:04:07.594964 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f28efe75-45ff-4c27-90b7-3025a3177204 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.236399 Oct 04 09:04:07.595860 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 544/1135] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Oct 4 09:04:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:31.421150 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=3 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:31.422344 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=7 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:31.428050 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2005878436", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1659556079", "security_groups": [{"name": "tempest-secgroup-smoke-1388657652"}], "networks": [{"uuid": "f02ba3c6-dc1e-47cb-9791-9b0614280d22"}], "block_device_mapping_v2": [{"uuid": "dbbf1cc8-5292-4992-86cb-da3c3745bc0d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:31.548465 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.network.neutron [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] validate_networks() for [('f02ba3c6-dc1e-47cb-9791-9b0614280d22', None, None, None, None, None)] {{(pid=142438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:04:32.034047 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Flavor limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:04:32.034472 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Image limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:04:32.034967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Flavor pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:04:32.035450 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Image pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:04:32.035859 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:04:32.044963 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:32.045433 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:32.045860 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:32.046572 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:32.047020 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:32.047435 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:32.064209 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Getting quotas for project 1c3592efc4ea4562a7b38a9189c7d04f. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:04:32.068395 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Getting quotas for user 6cfec539e6dc404fa692139310733d31 and project 1c3592efc4ea4562a7b38a9189c7d04f. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:04:32.127412 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Going to run 1 instances... {{(pid=142438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:04:32.129706 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dbbf1cc8-5292-4992-86cb-da3c3745bc0d',volume_size=None,volume_type=None)] {{(pid=142438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:04:32.274110 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a4a0fb5c-e412-42ba-b658-a968ac5393d6 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.857736 Oct 04 09:04:32.274766 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 592/1136] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 09:04:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 09:04:32.283739 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=4 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:32.284505 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:32.288606 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-556a9b52-d54e-47a4-bf09-a4124f0b3348 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:32.289343 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-556a9b52-d54e-47a4-bf09-a4124f0b3348 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:32.344735 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-556a9b52-d54e-47a4-bf09-a4124f0b3348 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:32.351849 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-556a9b52-d54e-47a4-bf09-a4124f0b3348 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1089 microversion: 2.1 time: 0.069574 Oct 04 09:04:32.352684 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 545/1137] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:32 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:33.378894 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ffd9df43-05bb-49cd-8439-d0ee693c397f tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:33.380012 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ffd9df43-05bb-49cd-8439-d0ee693c397f tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:33.391576 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffd9df43-05bb-49cd-8439-d0ee693c397f tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:33.392330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffd9df43-05bb-49cd-8439-d0ee693c397f tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:33.393055 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffd9df43-05bb-49cd-8439-d0ee693c397f tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:33.394186 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffd9df43-05bb-49cd-8439-d0ee693c397f tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:33.394934 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffd9df43-05bb-49cd-8439-d0ee693c397f tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:33.395634 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ffd9df43-05bb-49cd-8439-d0ee693c397f tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:33.465723 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ffd9df43-05bb-49cd-8439-d0ee693c397f tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:33.473985 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ffd9df43-05bb-49cd-8439-d0ee693c397f tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1187 microversion: 2.1 time: 0.101736 Oct 04 09:04:33.474521 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 593/1138] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:33 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1187 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:34.500159 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-043c9147-3aaf-450b-ae27-f20d223899c0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:34.501351 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-043c9147-3aaf-450b-ae27-f20d223899c0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:34.509236 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-043c9147-3aaf-450b-ae27-f20d223899c0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:34.509733 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-043c9147-3aaf-450b-ae27-f20d223899c0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:34.510188 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-043c9147-3aaf-450b-ae27-f20d223899c0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:34.510886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-043c9147-3aaf-450b-ae27-f20d223899c0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:34.511339 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-043c9147-3aaf-450b-ae27-f20d223899c0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:34.511761 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-043c9147-3aaf-450b-ae27-f20d223899c0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:34.665005 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-043c9147-3aaf-450b-ae27-f20d223899c0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:34.673531 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-043c9147-3aaf-450b-ae27-f20d223899c0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1273 microversion: 2.1 time: 0.178324 Oct 04 09:04:34.674312 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 546/1139] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:34 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:35.167227 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-8ff42771-5c1e-4178-99a4-acb19d1d71ea req-377c9f36-df17-470e-9166-6733646e3c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a22dc3-e2b5-48af-a968-ca6ecdfc50e8", "tag": "8d2a9d8b-a2ca-4a6d-b218-6582fd84af52"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:35.176847 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-8ff42771-5c1e-4178-99a4-acb19d1d71ea req-377c9f36-df17-470e-9166-6733646e3c24 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:35.177379 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-8ff42771-5c1e-4178-99a4-acb19d1d71ea req-377c9f36-df17-470e-9166-6733646e3c24 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:35.177866 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-8ff42771-5c1e-4178-99a4-acb19d1d71ea req-377c9f36-df17-470e-9166-6733646e3c24 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:35.191727 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-8ff42771-5c1e-4178-99a4-acb19d1d71ea req-377c9f36-df17-470e-9166-6733646e3c24 service nova] Creating event network-changed:8d2a9d8b-a2ca-4a6d-b218-6582fd84af52 for instance 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 on hv-cinder-84456 Oct 04 09:04:35.197114 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-8ff42771-5c1e-4178-99a4-acb19d1d71ea req-377c9f36-df17-470e-9166-6733646e3c24 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098341 Oct 04 09:04:35.197902 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 594/1140] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:35.699261 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c0be1ef7-c07e-434c-b886-c3742a671288 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:35.699850 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c0be1ef7-c07e-434c-b886-c3742a671288 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:35.706662 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c0be1ef7-c07e-434c-b886-c3742a671288 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:35.707142 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c0be1ef7-c07e-434c-b886-c3742a671288 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:35.707567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c0be1ef7-c07e-434c-b886-c3742a671288 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:35.708294 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c0be1ef7-c07e-434c-b886-c3742a671288 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:35.708734 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c0be1ef7-c07e-434c-b886-c3742a671288 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:35.709149 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c0be1ef7-c07e-434c-b886-c3742a671288 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:35.849965 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c0be1ef7-c07e-434c-b886-c3742a671288 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:35.860840 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c0be1ef7-c07e-434c-b886-c3742a671288 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1261 microversion: 2.1 time: 0.165797 Oct 04 09:04:35.861607 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 547/1141] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:35 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:36.888328 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ef0d5ed8-0bd7-4e1c-8238-290f0be476fb tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:36.888960 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ef0d5ed8-0bd7-4e1c-8238-290f0be476fb tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:36.895404 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef0d5ed8-0bd7-4e1c-8238-290f0be476fb tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:36.895906 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef0d5ed8-0bd7-4e1c-8238-290f0be476fb tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:36.896337 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef0d5ed8-0bd7-4e1c-8238-290f0be476fb tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:36.897145 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef0d5ed8-0bd7-4e1c-8238-290f0be476fb tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:36.897642 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef0d5ed8-0bd7-4e1c-8238-290f0be476fb tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:36.898223 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ef0d5ed8-0bd7-4e1c-8238-290f0be476fb tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:37.028750 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ef0d5ed8-0bd7-4e1c-8238-290f0be476fb tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:37.036710 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ef0d5ed8-0bd7-4e1c-8238-290f0be476fb tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1261 microversion: 2.1 time: 0.155660 Oct 04 09:04:37.037287 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 595/1142] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:36 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:38.062940 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2a99514e-cde8-46e6-80f1-50c3f4597e7a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:38.063958 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2a99514e-cde8-46e6-80f1-50c3f4597e7a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:38.073567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2a99514e-cde8-46e6-80f1-50c3f4597e7a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:38.074089 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2a99514e-cde8-46e6-80f1-50c3f4597e7a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:38.074559 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2a99514e-cde8-46e6-80f1-50c3f4597e7a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:38.075341 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2a99514e-cde8-46e6-80f1-50c3f4597e7a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:38.075849 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2a99514e-cde8-46e6-80f1-50c3f4597e7a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:38.076304 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2a99514e-cde8-46e6-80f1-50c3f4597e7a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:38.210650 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2a99514e-cde8-46e6-80f1-50c3f4597e7a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:38.218785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2a99514e-cde8-46e6-80f1-50c3f4597e7a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1261 microversion: 2.1 time: 0.162510 Oct 04 09:04:38.219351 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 548/1143] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:38 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:39.245893 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e34a5ec2-1058-4b37-a754-42318bb67185 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:39.246625 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e34a5ec2-1058-4b37-a754-42318bb67185 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:39.255774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e34a5ec2-1058-4b37-a754-42318bb67185 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:39.256461 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e34a5ec2-1058-4b37-a754-42318bb67185 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:39.257056 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e34a5ec2-1058-4b37-a754-42318bb67185 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:39.258041 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e34a5ec2-1058-4b37-a754-42318bb67185 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:39.258695 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e34a5ec2-1058-4b37-a754-42318bb67185 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:39.259252 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e34a5ec2-1058-4b37-a754-42318bb67185 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:39.396654 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e34a5ec2-1058-4b37-a754-42318bb67185 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:39.404813 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e34a5ec2-1058-4b37-a754-42318bb67185 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1261 microversion: 2.1 time: 0.165492 Oct 04 09:04:39.405382 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 596/1144] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:39 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:40.430750 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5e728089-9d76-40f8-86de-f42687c08590 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:40.431859 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5e728089-9d76-40f8-86de-f42687c08590 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:40.442470 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5e728089-9d76-40f8-86de-f42687c08590 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:40.443349 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5e728089-9d76-40f8-86de-f42687c08590 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:40.444203 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5e728089-9d76-40f8-86de-f42687c08590 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:40.445334 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5e728089-9d76-40f8-86de-f42687c08590 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:40.446539 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5e728089-9d76-40f8-86de-f42687c08590 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:40.446826 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5e728089-9d76-40f8-86de-f42687c08590 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:40.586095 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5e728089-9d76-40f8-86de-f42687c08590 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:40.594634 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5e728089-9d76-40f8-86de-f42687c08590 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1261 microversion: 2.1 time: 0.170408 Oct 04 09:04:40.595208 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 549/1145] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:40 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:41.267791 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d5bc2dca-5c34-47c9-95c7-ce0c24da4ae7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:41.268397 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d5bc2dca-5c34-47c9-95c7-ce0c24da4ae7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:41.275259 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5bc2dca-5c34-47c9-95c7-ce0c24da4ae7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:41.275739 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5bc2dca-5c34-47c9-95c7-ce0c24da4ae7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:41.276201 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5bc2dca-5c34-47c9-95c7-ce0c24da4ae7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:41.276916 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5bc2dca-5c34-47c9-95c7-ce0c24da4ae7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:41.277357 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5bc2dca-5c34-47c9-95c7-ce0c24da4ae7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:41.277774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d5bc2dca-5c34-47c9-95c7-ce0c24da4ae7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:41.301593 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d5bc2dca-5c34-47c9-95c7-ce0c24da4ae7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303/ips" status: 200 len: 151 microversion: 2.1 time: 0.037806 Oct 04 09:04:41.302154 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 597/1146] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Oct 4 09:04:41 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:41.622594 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1fff77a8-2cb7-41c3-8253-e57f63b3040a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:41.623216 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1fff77a8-2cb7-41c3-8253-e57f63b3040a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:41.629493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1fff77a8-2cb7-41c3-8253-e57f63b3040a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:41.630017 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1fff77a8-2cb7-41c3-8253-e57f63b3040a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:41.630457 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1fff77a8-2cb7-41c3-8253-e57f63b3040a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:41.631152 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1fff77a8-2cb7-41c3-8253-e57f63b3040a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:41.631634 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1fff77a8-2cb7-41c3-8253-e57f63b3040a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:41.632088 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1fff77a8-2cb7-41c3-8253-e57f63b3040a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:41.765775 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1fff77a8-2cb7-41c3-8253-e57f63b3040a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:41.773560 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1fff77a8-2cb7-41c3-8253-e57f63b3040a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1261 microversion: 2.1 time: 0.158065 Oct 04 09:04:41.774130 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 550/1147] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:41 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:42.698773 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7ccf5f2a-3c70-4d39-a039-ff2b150478d6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73281869-bfda-4350-92b5-be4d62ac425e"}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:42.701276 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7ccf5f2a-3c70-4d39-a039-ff2b150478d6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:42.703296 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:42.704013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=6 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:42.710502 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7ccf5f2a-3c70-4d39-a039-ff2b150478d6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:42.710983 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7ccf5f2a-3c70-4d39-a039-ff2b150478d6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:42.711421 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7ccf5f2a-3c70-4d39-a039-ff2b150478d6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:42.712152 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7ccf5f2a-3c70-4d39-a039-ff2b150478d6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:42.712610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7ccf5f2a-3c70-4d39-a039-ff2b150478d6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:42.713035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7ccf5f2a-3c70-4d39-a039-ff2b150478d6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:42.797802 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5a4db7a8-7e8f-40da-a3e3-95f3da87c4c1 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:42.798488 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5a4db7a8-7e8f-40da-a3e3-95f3da87c4c1 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:42.801546 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:42.806159 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5a4db7a8-7e8f-40da-a3e3-95f3da87c4c1 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:42.806632 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5a4db7a8-7e8f-40da-a3e3-95f3da87c4c1 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:42.807094 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5a4db7a8-7e8f-40da-a3e3-95f3da87c4c1 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:42.808015 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5a4db7a8-7e8f-40da-a3e3-95f3da87c4c1 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:42.808251 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5a4db7a8-7e8f-40da-a3e3-95f3da87c4c1 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:42.808737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5a4db7a8-7e8f-40da-a3e3-95f3da87c4c1 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:42.951101 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5a4db7a8-7e8f-40da-a3e3-95f3da87c4c1 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:42.962402 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5a4db7a8-7e8f-40da-a3e3-95f3da87c4c1 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1261 microversion: 2.1 time: 0.170154 Oct 04 09:04:42.963669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 551/1148] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:42 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:04:43.005304 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7ccf5f2a-3c70-4d39-a039-ff2b150478d6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "POST /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311522 Oct 04 09:04:43.005964 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 598/1149] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Oct 4 09:04:42 2022] POST /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:43.986978 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a5310226-cb6d-48c9-8dcb-3ed21b904546 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:43.987565 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a5310226-cb6d-48c9-8dcb-3ed21b904546 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:43.994551 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a5310226-cb6d-48c9-8dcb-3ed21b904546 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:43.995340 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a5310226-cb6d-48c9-8dcb-3ed21b904546 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:43.995788 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a5310226-cb6d-48c9-8dcb-3ed21b904546 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:43.996573 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a5310226-cb6d-48c9-8dcb-3ed21b904546 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:43.997111 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a5310226-cb6d-48c9-8dcb-3ed21b904546 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:43.997684 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a5310226-cb6d-48c9-8dcb-3ed21b904546 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:44.141585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-a5310226-cb6d-48c9-8dcb-3ed21b904546 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:44.149526 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a5310226-cb6d-48c9-8dcb-3ed21b904546 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1261 microversion: 2.1 time: 0.166527 Oct 04 09:04:44.150095 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 552/1150] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:43 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:45.172861 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-13d68bba-86c5-440f-bb6b-31a8fe13428c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:45.174101 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-13d68bba-86c5-440f-bb6b-31a8fe13428c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:45.194089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-13d68bba-86c5-440f-bb6b-31a8fe13428c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:45.194089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-13d68bba-86c5-440f-bb6b-31a8fe13428c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:45.194089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-13d68bba-86c5-440f-bb6b-31a8fe13428c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:45.194089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-13d68bba-86c5-440f-bb6b-31a8fe13428c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:45.194493 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-13d68bba-86c5-440f-bb6b-31a8fe13428c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:45.194493 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-13d68bba-86c5-440f-bb6b-31a8fe13428c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:45.322021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-13d68bba-86c5-440f-bb6b-31a8fe13428c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:45.331496 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-13d68bba-86c5-440f-bb6b-31a8fe13428c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1261 microversion: 2.1 time: 0.163424 Oct 04 09:04:45.332104 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 599/1151] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:45 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:46.357977 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6bf16763-7267-4278-90fe-36396bfb37ba tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:46.358606 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-6bf16763-7267-4278-90fe-36396bfb37ba tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:46.366609 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6bf16763-7267-4278-90fe-36396bfb37ba tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:46.367267 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6bf16763-7267-4278-90fe-36396bfb37ba tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:46.367741 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6bf16763-7267-4278-90fe-36396bfb37ba tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:46.368589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6bf16763-7267-4278-90fe-36396bfb37ba tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:46.369245 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6bf16763-7267-4278-90fe-36396bfb37ba tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:46.369848 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-6bf16763-7267-4278-90fe-36396bfb37ba tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:46.512183 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-6bf16763-7267-4278-90fe-36396bfb37ba tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:46.520122 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6bf16763-7267-4278-90fe-36396bfb37ba tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1261 microversion: 2.1 time: 0.167930 Oct 04 09:04:46.520693 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 553/1152] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:46 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:46.595552 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-1e81b4ab-6bda-4015-91a6-e3e232b13818 req-7665ca71-0582-49b8-ae14-ab4b71b4b835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a22dc3-e2b5-48af-a968-ca6ecdfc50e8", "name": "network-vif-plugged", "status": "completed", "tag": "8d2a9d8b-a2ca-4a6d-b218-6582fd84af52"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:46.605426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-1e81b4ab-6bda-4015-91a6-e3e232b13818 req-7665ca71-0582-49b8-ae14-ab4b71b4b835 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:46.606188 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-1e81b4ab-6bda-4015-91a6-e3e232b13818 req-7665ca71-0582-49b8-ae14-ab4b71b4b835 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:46.606773 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-1e81b4ab-6bda-4015-91a6-e3e232b13818 req-7665ca71-0582-49b8-ae14-ab4b71b4b835 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:46.622199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-1e81b4ab-6bda-4015-91a6-e3e232b13818 req-7665ca71-0582-49b8-ae14-ab4b71b4b835 service nova] Creating event network-vif-plugged:8d2a9d8b-a2ca-4a6d-b218-6582fd84af52 for instance 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 on hv-cinder-84456 Oct 04 09:04:46.626904 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-1e81b4ab-6bda-4015-91a6-e3e232b13818 req-7665ca71-0582-49b8-ae14-ab4b71b4b835 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089447 Oct 04 09:04:46.627529 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 600/1153] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:47.544673 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0c65a92f-3b6a-4856-8f4a-288c13bacad0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:47.545382 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0c65a92f-3b6a-4856-8f4a-288c13bacad0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:47.553793 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0c65a92f-3b6a-4856-8f4a-288c13bacad0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:47.554397 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0c65a92f-3b6a-4856-8f4a-288c13bacad0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:47.554941 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0c65a92f-3b6a-4856-8f4a-288c13bacad0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:47.555800 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0c65a92f-3b6a-4856-8f4a-288c13bacad0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:47.556473 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0c65a92f-3b6a-4856-8f4a-288c13bacad0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:47.557041 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0c65a92f-3b6a-4856-8f4a-288c13bacad0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:47.699639 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0c65a92f-3b6a-4856-8f4a-288c13bacad0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:47.708236 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0c65a92f-3b6a-4856-8f4a-288c13bacad0 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1261 microversion: 2.1 time: 0.168387 Oct 04 09:04:47.708851 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 554/1154] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:47 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:48.736718 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8c2232b0-491c-42a1-9d6a-fd194ad2ccd8 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:48.737872 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8c2232b0-491c-42a1-9d6a-fd194ad2ccd8 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:48.748868 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c2232b0-491c-42a1-9d6a-fd194ad2ccd8 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:48.749405 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c2232b0-491c-42a1-9d6a-fd194ad2ccd8 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:48.749907 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c2232b0-491c-42a1-9d6a-fd194ad2ccd8 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:48.750616 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c2232b0-491c-42a1-9d6a-fd194ad2ccd8 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:48.751082 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c2232b0-491c-42a1-9d6a-fd194ad2ccd8 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:48.751505 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c2232b0-491c-42a1-9d6a-fd194ad2ccd8 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:48.892062 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8c2232b0-491c-42a1-9d6a-fd194ad2ccd8 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:48.900132 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8c2232b0-491c-42a1-9d6a-fd194ad2ccd8 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1261 microversion: 2.1 time: 0.171109 Oct 04 09:04:48.900689 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 601/1155] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:48 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:49.923607 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5ec26681-5920-44aa-9a4d-13abd5bc6fc9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:49.924283 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5ec26681-5920-44aa-9a4d-13abd5bc6fc9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:49.930725 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ec26681-5920-44aa-9a4d-13abd5bc6fc9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:49.931208 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ec26681-5920-44aa-9a4d-13abd5bc6fc9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:49.931642 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ec26681-5920-44aa-9a4d-13abd5bc6fc9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:49.932375 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ec26681-5920-44aa-9a4d-13abd5bc6fc9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:49.932829 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ec26681-5920-44aa-9a4d-13abd5bc6fc9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:49.933252 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5ec26681-5920-44aa-9a4d-13abd5bc6fc9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:50.077734 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5ec26681-5920-44aa-9a4d-13abd5bc6fc9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:50.089277 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5ec26681-5920-44aa-9a4d-13abd5bc6fc9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1445 microversion: 2.1 time: 0.169809 Oct 04 09:04:50.089842 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 555/1156] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:49 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1445 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:50.123691 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b245e928-9973-49e1-b034-1e9a4f908275 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:50.124960 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b245e928-9973-49e1-b034-1e9a4f908275 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:50.135747 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b245e928-9973-49e1-b034-1e9a4f908275 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:50.136599 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b245e928-9973-49e1-b034-1e9a4f908275 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:50.137330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b245e928-9973-49e1-b034-1e9a4f908275 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:50.138249 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b245e928-9973-49e1-b034-1e9a4f908275 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:50.138696 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b245e928-9973-49e1-b034-1e9a4f908275 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:50.139114 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b245e928-9973-49e1-b034-1e9a4f908275 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:50.274642 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b245e928-9973-49e1-b034-1e9a4f908275 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:50.282789 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b245e928-9973-49e1-b034-1e9a4f908275 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1445 microversion: 2.1 time: 0.163822 Oct 04 09:04:50.283333 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 602/1157] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:50 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1445 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:50.610902 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6c3cfd1c-b23b-4138-ab6d-af7aade0e931 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Action: 'create', calling method: .version_select at 0x7ff92e250700>, body: {"keypair": {"name": "tempest-keypair-1787488835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZz55q7NNnsdql5YJu9jQ5OYbggjUvEIWp8W/RUJ6CPLeKXmFZq7rI979OcNhglRUoTezfaNavREOigI/PY3BtV4biR3pM5w6Jb6B+B5xoUvVYCj4N7K/aDeXKUsVM24A=="}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:50.628004 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-6c3cfd1c-b23b-4138-ab6d-af7aade0e931 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:04:50.632676 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-6c3cfd1c-b23b-4138-ab6d-af7aade0e931 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for user 3ec88da1704d44fb924fa3cc04e5fe25 and project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:04:50.655671 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6c3cfd1c-b23b-4138-ab6d-af7aade0e931 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049163 Oct 04 09:04:50.656437 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 556/1158] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Oct 4 09:04:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:51.993090 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1311426120", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20cff610-f8c7-446f-a4a5-54f1f06f39ee"}], "security_groups": [{"name": "tempest-securitygroup--1877444470"}], "key_name": "tempest-keypair-1787488835", "user_data": "}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:52.099203 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.network.neutron [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] validate_networks() for [('20cff610-f8c7-446f-a4a5-54f1f06f39ee', None, None, None, None, None)] {{(pid=142438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:04:52.484162 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Flavor limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:04:52.484587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Image limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:04:52.485089 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Flavor pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:04:52.485500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Image pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:04:52.485913 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:04:52.495287 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:52.495796 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:52.496269 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:52.497033 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:52.497478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:52.497894 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:52.515126 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:04:52.519838 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for user 3ec88da1704d44fb924fa3cc04e5fe25 and project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:04:52.532503 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Going to run 1 instances... {{(pid=142438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:04:52.534797 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:04:52.586466 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-9792131d-8b5b-40f8-a723-5babb833b413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.598165 Oct 04 09:04:52.587477 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 603/1159] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 09:04:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 09:04:52.599055 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-cc42d919-855f-4898-89c1-862e67a8b732 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:52.599982 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-cc42d919-855f-4898-89c1-862e67a8b732 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:52.662900 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-cc42d919-855f-4898-89c1-862e67a8b732 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:52.674259 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-cc42d919-855f-4898-89c1-862e67a8b732 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1242 microversion: 2.1 time: 0.079320 Oct 04 09:04:52.676114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 557/1160] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:52 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:52.828285 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-774ff787-3b72-492a-ad77-63c412e9a6e5 req-0b35f7b6-24f1-40d5-b6d4-5d6102908a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a22dc3-e2b5-48af-a968-ca6ecdfc50e8", "tag": "8d2a9d8b-a2ca-4a6d-b218-6582fd84af52"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:52.839467 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-774ff787-3b72-492a-ad77-63c412e9a6e5 req-0b35f7b6-24f1-40d5-b6d4-5d6102908a47 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:52.840550 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-774ff787-3b72-492a-ad77-63c412e9a6e5 req-0b35f7b6-24f1-40d5-b6d4-5d6102908a47 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:52.841160 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-774ff787-3b72-492a-ad77-63c412e9a6e5 req-0b35f7b6-24f1-40d5-b6d4-5d6102908a47 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:52.853484 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-774ff787-3b72-492a-ad77-63c412e9a6e5 req-0b35f7b6-24f1-40d5-b6d4-5d6102908a47 service nova] Creating event network-changed:8d2a9d8b-a2ca-4a6d-b218-6582fd84af52 for instance 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 on hv-cinder-84456 Oct 04 09:04:52.859351 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-774ff787-3b72-492a-ad77-63c412e9a6e5 req-0b35f7b6-24f1-40d5-b6d4-5d6102908a47 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035491 Oct 04 09:04:52.860850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 604/1161] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 09:04:53.089010 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-117b4482-58e4-408e-9ffb-4649500d2e37 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:53.090557 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-117b4482-58e4-408e-9ffb-4649500d2e37 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:53.098963 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-117b4482-58e4-408e-9ffb-4649500d2e37 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:53.100469 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-117b4482-58e4-408e-9ffb-4649500d2e37 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:53.101152 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-117b4482-58e4-408e-9ffb-4649500d2e37 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:53.102880 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-117b4482-58e4-408e-9ffb-4649500d2e37 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:53.104082 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-117b4482-58e4-408e-9ffb-4649500d2e37 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:53.104739 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-117b4482-58e4-408e-9ffb-4649500d2e37 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:53.171117 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-117b4482-58e4-408e-9ffb-4649500d2e37 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Going to try to terminate instance {{(pid=142439) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:04:53.317934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-117b4482-58e4-408e-9ffb-4649500d2e37 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 204 len: 0 microversion: 2.1 time: 0.234385 Oct 04 09:04:53.318916 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 558/1162] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:04:53 2022] DELETE /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:04:53.328380 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8c2f5b51-e66a-4b7b-b0f8-1ddc31553da2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:53.329733 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8c2f5b51-e66a-4b7b-b0f8-1ddc31553da2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:53.336050 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c2f5b51-e66a-4b7b-b0f8-1ddc31553da2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:53.336539 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c2f5b51-e66a-4b7b-b0f8-1ddc31553da2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:53.336975 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c2f5b51-e66a-4b7b-b0f8-1ddc31553da2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:53.337684 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c2f5b51-e66a-4b7b-b0f8-1ddc31553da2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:53.338137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c2f5b51-e66a-4b7b-b0f8-1ddc31553da2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:53.338753 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c2f5b51-e66a-4b7b-b0f8-1ddc31553da2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:53.498125 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8c2f5b51-e66a-4b7b-b0f8-1ddc31553da2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:53.507115 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8c2f5b51-e66a-4b7b-b0f8-1ddc31553da2 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1574 microversion: 2.1 time: 0.183514 Oct 04 09:04:53.508890 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 605/1163] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:53 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:04:53.702580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5f167ad3-47b7-4137-a4ca-ff280528d2ac tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:53.703277 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5f167ad3-47b7-4137-a4ca-ff280528d2ac tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:53.710390 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5f167ad3-47b7-4137-a4ca-ff280528d2ac tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:53.710876 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5f167ad3-47b7-4137-a4ca-ff280528d2ac tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:53.711306 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5f167ad3-47b7-4137-a4ca-ff280528d2ac tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:53.712043 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5f167ad3-47b7-4137-a4ca-ff280528d2ac tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:53.712493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5f167ad3-47b7-4137-a4ca-ff280528d2ac tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:53.712914 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5f167ad3-47b7-4137-a4ca-ff280528d2ac tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:53.776869 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5f167ad3-47b7-4137-a4ca-ff280528d2ac tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:53.784998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5f167ad3-47b7-4137-a4ca-ff280528d2ac tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1294 microversion: 2.1 time: 0.086907 Oct 04 09:04:53.785584 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 559/1164] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:53 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:54.531468 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6e7aef02-a2aa-4317-976e-957608dbf172 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:54.532169 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6e7aef02-a2aa-4317-976e-957608dbf172 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:54.539539 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e7aef02-a2aa-4317-976e-957608dbf172 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:54.540021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e7aef02-a2aa-4317-976e-957608dbf172 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:54.540451 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e7aef02-a2aa-4317-976e-957608dbf172 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:54.541199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e7aef02-a2aa-4317-976e-957608dbf172 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:54.542340 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e7aef02-a2aa-4317-976e-957608dbf172 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:54.542770 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6e7aef02-a2aa-4317-976e-957608dbf172 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:54.684868 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-6e7aef02-a2aa-4317-976e-957608dbf172 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:54.695305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6e7aef02-a2aa-4317-976e-957608dbf172 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1574 microversion: 2.1 time: 0.168026 Oct 04 09:04:54.695894 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 606/1165] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:54 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:54.808648 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d2f52f82-785b-42ac-a4f7-be5b507eae53 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:54.809187 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d2f52f82-785b-42ac-a4f7-be5b507eae53 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:54.816006 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d2f52f82-785b-42ac-a4f7-be5b507eae53 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:54.816491 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d2f52f82-785b-42ac-a4f7-be5b507eae53 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:54.816917 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d2f52f82-785b-42ac-a4f7-be5b507eae53 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:54.817601 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d2f52f82-785b-42ac-a4f7-be5b507eae53 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:54.818045 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d2f52f82-785b-42ac-a4f7-be5b507eae53 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:54.818460 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d2f52f82-785b-42ac-a4f7-be5b507eae53 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:54.884524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d2f52f82-785b-42ac-a4f7-be5b507eae53 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:54.892557 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d2f52f82-785b-42ac-a4f7-be5b507eae53 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1294 microversion: 2.1 time: 0.087949 Oct 04 09:04:54.893377 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 560/1166] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:54 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:54.898045 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-b60a55f3-302b-4b6d-aa51-00f779bd37f0 req-c08815fb-b428-4f2e-9931-170a97c2db29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f473325-1877-43e1-8150-90eeadbdd17a", "tag": "e3ff2094-e984-4eea-ac2f-ef4e15fcfe78"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:54.907355 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-b60a55f3-302b-4b6d-aa51-00f779bd37f0 req-c08815fb-b428-4f2e-9931-170a97c2db29 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:54.907820 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-b60a55f3-302b-4b6d-aa51-00f779bd37f0 req-c08815fb-b428-4f2e-9931-170a97c2db29 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:54.908394 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-b60a55f3-302b-4b6d-aa51-00f779bd37f0 req-c08815fb-b428-4f2e-9931-170a97c2db29 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:54.919261 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-b60a55f3-302b-4b6d-aa51-00f779bd37f0 req-c08815fb-b428-4f2e-9931-170a97c2db29 service nova] Creating event network-changed:e3ff2094-e984-4eea-ac2f-ef4e15fcfe78 for instance 4f473325-1877-43e1-8150-90eeadbdd17a on hv-cinder-84456 Oct 04 09:04:54.924324 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-b60a55f3-302b-4b6d-aa51-00f779bd37f0 req-c08815fb-b428-4f2e-9931-170a97c2db29 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029905 Oct 04 09:04:54.924890 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 607/1167] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:55.719855 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-53e4227f-ecb2-4c20-92ae-821ea2b9d2b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:55.720797 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-53e4227f-ecb2-4c20-92ae-821ea2b9d2b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:55.728785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-53e4227f-ecb2-4c20-92ae-821ea2b9d2b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:55.729280 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-53e4227f-ecb2-4c20-92ae-821ea2b9d2b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:55.729905 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-53e4227f-ecb2-4c20-92ae-821ea2b9d2b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:55.730617 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-53e4227f-ecb2-4c20-92ae-821ea2b9d2b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:55.731077 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-53e4227f-ecb2-4c20-92ae-821ea2b9d2b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:55.731571 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-53e4227f-ecb2-4c20-92ae-821ea2b9d2b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:55.866342 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-53e4227f-ecb2-4c20-92ae-821ea2b9d2b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:55.874625 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-53e4227f-ecb2-4c20-92ae-821ea2b9d2b9 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1574 microversion: 2.1 time: 0.159663 Oct 04 09:04:55.875320 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 561/1168] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:55 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:55.916301 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-73725fd1-8c48-452d-84bb-562561af9ae3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:55.916926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-73725fd1-8c48-452d-84bb-562561af9ae3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:55.923526 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-73725fd1-8c48-452d-84bb-562561af9ae3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:55.924034 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-73725fd1-8c48-452d-84bb-562561af9ae3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:55.924458 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-73725fd1-8c48-452d-84bb-562561af9ae3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:55.925139 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-73725fd1-8c48-452d-84bb-562561af9ae3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:55.925587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-73725fd1-8c48-452d-84bb-562561af9ae3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:55.926002 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-73725fd1-8c48-452d-84bb-562561af9ae3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:55.994329 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-73725fd1-8c48-452d-84bb-562561af9ae3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:56.002358 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-73725fd1-8c48-452d-84bb-562561af9ae3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1300 microversion: 2.1 time: 0.091304 Oct 04 09:04:56.002940 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 608/1169] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:55 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:56.899224 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5059d409-16b9-47ab-b2fb-38e71697f369 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:56.900397 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5059d409-16b9-47ab-b2fb-38e71697f369 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:56.909283 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5059d409-16b9-47ab-b2fb-38e71697f369 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:56.910025 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5059d409-16b9-47ab-b2fb-38e71697f369 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:56.910651 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5059d409-16b9-47ab-b2fb-38e71697f369 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:56.911561 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5059d409-16b9-47ab-b2fb-38e71697f369 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:56.912224 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5059d409-16b9-47ab-b2fb-38e71697f369 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:56.912900 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5059d409-16b9-47ab-b2fb-38e71697f369 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:56.944871 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-018acd3f-8c6c-49f6-8c4f-4ac9c828db26 req-ad801f80-2e5d-4fc2-8457-202ae6670efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f473325-1877-43e1-8150-90eeadbdd17a", "name": "network-vif-deleted", "tag": "e3ff2094-e984-4eea-ac2f-ef4e15fcfe78"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:56.957564 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-018acd3f-8c6c-49f6-8c4f-4ac9c828db26 req-ad801f80-2e5d-4fc2-8457-202ae6670efa service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:56.958360 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-018acd3f-8c6c-49f6-8c4f-4ac9c828db26 req-ad801f80-2e5d-4fc2-8457-202ae6670efa service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:56.960064 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-018acd3f-8c6c-49f6-8c4f-4ac9c828db26 req-ad801f80-2e5d-4fc2-8457-202ae6670efa service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:56.978984 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-018acd3f-8c6c-49f6-8c4f-4ac9c828db26 req-ad801f80-2e5d-4fc2-8457-202ae6670efa service nova] Creating event network-vif-deleted:e3ff2094-e984-4eea-ac2f-ef4e15fcfe78 for instance 4f473325-1877-43e1-8150-90eeadbdd17a on hv-cinder-84456 Oct 04 09:04:56.986653 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-018acd3f-8c6c-49f6-8c4f-4ac9c828db26 req-ad801f80-2e5d-4fc2-8457-202ae6670efa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047757 Oct 04 09:04:56.987517 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 609/1170] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 09:04:56.997267 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5059d409-16b9-47ab-b2fb-38e71697f369 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:57.000968 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:57.006066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5059d409-16b9-47ab-b2fb-38e71697f369 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 200 len: 1391 microversion: 2.1 time: 0.111566 Oct 04 09:04:57.006663 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 562/1171] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:56 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 1391 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:57.026389 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c1566eb3-2287-4bcd-ad47-1e3aa4c8fe3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:57.027132 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c1566eb3-2287-4bcd-ad47-1e3aa4c8fe3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:57.033535 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c1566eb3-2287-4bcd-ad47-1e3aa4c8fe3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:57.034017 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c1566eb3-2287-4bcd-ad47-1e3aa4c8fe3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:57.034442 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c1566eb3-2287-4bcd-ad47-1e3aa4c8fe3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:57.035122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c1566eb3-2287-4bcd-ad47-1e3aa4c8fe3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:57.035567 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c1566eb3-2287-4bcd-ad47-1e3aa4c8fe3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:57.036009 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c1566eb3-2287-4bcd-ad47-1e3aa4c8fe3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:57.101025 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c1566eb3-2287-4bcd-ad47-1e3aa4c8fe3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:57.109671 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c1566eb3-2287-4bcd-ad47-1e3aa4c8fe3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1300 microversion: 2.1 time: 0.087394 Oct 04 09:04:57.110277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 610/1172] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:57 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:58.029079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-612ee14d-22de-4f7e-b8c0-86ed3ce3e041 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:58.029804 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-612ee14d-22de-4f7e-b8c0-86ed3ce3e041 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 4f473325-1877-43e1-8150-90eeadbdd17a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:58.037584 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-612ee14d-22de-4f7e-b8c0-86ed3ce3e041 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:58.038396 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-612ee14d-22de-4f7e-b8c0-86ed3ce3e041 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:58.038920 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-612ee14d-22de-4f7e-b8c0-86ed3ce3e041 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:58.039697 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-612ee14d-22de-4f7e-b8c0-86ed3ce3e041 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:58.040259 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-612ee14d-22de-4f7e-b8c0-86ed3ce3e041 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:58.040681 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-612ee14d-22de-4f7e-b8c0-86ed3ce3e041 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:58.056007 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-612ee14d-22de-4f7e-b8c0-86ed3ce3e041 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] HTTP exception thrown: Instance 4f473325-1877-43e1-8150-90eeadbdd17a could not be found. Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-612ee14d-22de-4f7e-b8c0-86ed3ce3e041 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Request method failure captured: Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a HTTP/1.1 Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_TpG0P4hrI1_riDYCW34KMWgw3k8HzWWKQDWZN4OA7RwjFaVPPOlXJSC-4IxVkb5V0kx6OTMIVCK1VD-olX742a5fy61d1gJWzFSirdCfTUBSR7vb70g_ixOkSOfBAkkMSQxADOoP_L5-osTW9aLSB530f2shfykqfUZLOGXpEJtZI Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 881a40342cb84608b961e6b32dceadb4 Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-TestVolumeBootPattern-2116967592 Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:04:58.057658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:04:58.059468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_881a40342cb84608b961e6b32dceadb4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/881a40342cb84608b961e6b32dceadb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/881a40342cb84608b961e6b32dceadb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/881a40342cb84608b961e6b32dceadb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:04:58.059468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-TestVolumeBootPattern-2116967592 Oct 04 09:04:58.059468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 881a40342cb84608b961e6b32dceadb4 Oct 04 09:04:58.059468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116967592 Oct 04 09:04:58.059468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-TestVolumeBootPattern-2116967592-project Oct 04 09:04:58.059468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:04:58.059468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:04:58.059468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: d8d329978baf425e954b9965ae0cb652 Oct 04 09:04:58.059468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-TestVolumeBootPattern-2116967592-project Oct 04 09:04:58.059468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:04:58.059468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance 4f473325-1877-43e1-8150-90eeadbdd17a could not be found. Oct 04 09:04:58.059468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': '4f473325-1877-43e1-8150-90eeadbdd17a'} Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f473325-1877-43e1-8150-90eeadbdd17a could not be found. Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:04:58.060527 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f473325-1877-43e1-8150-90eeadbdd17a could not be found. Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f473325-1877-43e1-8150-90eeadbdd17a could not be found. Oct 04 09:04:58.062222 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:04:58.063862 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-612ee14d-22de-4f7e-b8c0-86ed3ce3e041 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Returning 404 to user: Instance 4f473325-1877-43e1-8150-90eeadbdd17a could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:04:58.063862 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-612ee14d-22de-4f7e-b8c0-86ed3ce3e041 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a" status: 404 len: 111 microversion: 2.1 time: 0.033976 Oct 04 09:04:58.063862 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 563/1173] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:58 2022] GET /compute/v2.1/servers/4f473325-1877-43e1-8150-90eeadbdd17a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:04:58.133681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-9cab95ce-c751-41ac-b3fd-268830890ff2 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:58.134846 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-9cab95ce-c751-41ac-b3fd-268830890ff2 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:58.142234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9cab95ce-c751-41ac-b3fd-268830890ff2 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:58.143036 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9cab95ce-c751-41ac-b3fd-268830890ff2 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:58.143614 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9cab95ce-c751-41ac-b3fd-268830890ff2 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:58.144531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9cab95ce-c751-41ac-b3fd-268830890ff2 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:58.145192 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9cab95ce-c751-41ac-b3fd-268830890ff2 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:58.145976 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-9cab95ce-c751-41ac-b3fd-268830890ff2 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:58.278987 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-9cab95ce-c751-41ac-b3fd-268830890ff2 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:58.286974 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-9cab95ce-c751-41ac-b3fd-268830890ff2 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1368 microversion: 2.1 time: 0.157442 Oct 04 09:04:58.287458 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 611/1174] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:58 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:59.029047 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-ee93559b-e7df-4a21-9cb6-0b298f2d90ec req-52f2de9c-da0f-4c47-a037-c3689ecccbf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3857fa0e-9f45-4f4f-91e4-565557da917e", "tag": "0000397c-08c2-4f58-a8d6-470a8aa92e02"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:59.045046 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-ee93559b-e7df-4a21-9cb6-0b298f2d90ec req-52f2de9c-da0f-4c47-a037-c3689ecccbf2 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:59.045628 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-ee93559b-e7df-4a21-9cb6-0b298f2d90ec req-52f2de9c-da0f-4c47-a037-c3689ecccbf2 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:59.045924 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-ee93559b-e7df-4a21-9cb6-0b298f2d90ec req-52f2de9c-da0f-4c47-a037-c3689ecccbf2 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:59.057216 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-ee93559b-e7df-4a21-9cb6-0b298f2d90ec req-52f2de9c-da0f-4c47-a037-c3689ecccbf2 service nova] Creating event network-changed:0000397c-08c2-4f58-a8d6-470a8aa92e02 for instance 3857fa0e-9f45-4f4f-91e4-565557da917e on hv-cinder-84456 Oct 04 09:04:59.062669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-ee93559b-e7df-4a21-9cb6-0b298f2d90ec req-52f2de9c-da0f-4c47-a037-c3689ecccbf2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040092 Oct 04 09:04:59.063645 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 564/1175] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:59.311413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-bc830234-f479-4c33-9338-c948b3c79914 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:59.312043 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-bc830234-f479-4c33-9338-c948b3c79914 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:59.318927 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc830234-f479-4c33-9338-c948b3c79914 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:59.319388 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc830234-f479-4c33-9338-c948b3c79914 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:59.319823 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc830234-f479-4c33-9338-c948b3c79914 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:59.320551 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc830234-f479-4c33-9338-c948b3c79914 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:59.321007 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc830234-f479-4c33-9338-c948b3c79914 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:59.321426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-bc830234-f479-4c33-9338-c948b3c79914 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:59.325529 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:59.467700 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-bc830234-f479-4c33-9338-c948b3c79914 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:59.475503 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-bc830234-f479-4c33-9338-c948b3c79914 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1368 microversion: 2.1 time: 0.169445 Oct 04 09:04:59.476107 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 612/1176] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:59 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:00.507583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-dc273b19-3dcd-479b-bad2-29ef823c28ae tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:00.508342 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-dc273b19-3dcd-479b-bad2-29ef823c28ae tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:00.514809 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc273b19-3dcd-479b-bad2-29ef823c28ae tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:00.515293 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc273b19-3dcd-479b-bad2-29ef823c28ae tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:00.515736 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc273b19-3dcd-479b-bad2-29ef823c28ae tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:00.516471 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc273b19-3dcd-479b-bad2-29ef823c28ae tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:00.516928 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc273b19-3dcd-479b-bad2-29ef823c28ae tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:00.517349 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc273b19-3dcd-479b-bad2-29ef823c28ae tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:00.919733 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dc273b19-3dcd-479b-bad2-29ef823c28ae tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:00.927542 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-dc273b19-3dcd-479b-bad2-29ef823c28ae tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1368 microversion: 2.1 time: 0.424887 Oct 04 09:05:00.928142 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 565/1177] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:00 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1368 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:01.547951 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8c922377-7b8a-4c16-ad9d-72e5630f2b68 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:01.549448 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8c922377-7b8a-4c16-ad9d-72e5630f2b68 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:01.551791 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-8b215a60-d3c7-4b44-af7c-33a186e3f3ce req-a29dee34-9ecc-40c6-a497-0b97c9b10ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61244f16-1483-4d31-a6de-0d4689a62479", "tag": "ad67ba62-fb95-40fd-bf8f-f28d45c2e22f"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:05:01.552294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:01.558069 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c922377-7b8a-4c16-ad9d-72e5630f2b68 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:01.558792 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c922377-7b8a-4c16-ad9d-72e5630f2b68 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:01.559914 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c922377-7b8a-4c16-ad9d-72e5630f2b68 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:01.560880 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c922377-7b8a-4c16-ad9d-72e5630f2b68 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:01.561542 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c922377-7b8a-4c16-ad9d-72e5630f2b68 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:01.562108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8c922377-7b8a-4c16-ad9d-72e5630f2b68 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:01.563389 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-8b215a60-d3c7-4b44-af7c-33a186e3f3ce req-a29dee34-9ecc-40c6-a497-0b97c9b10ad7 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:01.563982 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-8b215a60-d3c7-4b44-af7c-33a186e3f3ce req-a29dee34-9ecc-40c6-a497-0b97c9b10ad7 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:01.564478 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-8b215a60-d3c7-4b44-af7c-33a186e3f3ce req-a29dee34-9ecc-40c6-a497-0b97c9b10ad7 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:01.577111 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-8b215a60-d3c7-4b44-af7c-33a186e3f3ce req-a29dee34-9ecc-40c6-a497-0b97c9b10ad7 service nova] Creating event network-changed:ad67ba62-fb95-40fd-bf8f-f28d45c2e22f for instance 61244f16-1483-4d31-a6de-0d4689a62479 on hv-cinder-84456 Oct 04 09:05:01.582509 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-8b215a60-d3c7-4b44-af7c-33a186e3f3ce req-a29dee34-9ecc-40c6-a497-0b97c9b10ad7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034595 Oct 04 09:05:01.583112 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 566/1178] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:05:01.592374 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8c922377-7b8a-4c16-ad9d-72e5630f2b68 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Going to try to terminate instance {{(pid=142438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:05:01.693149 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8c922377-7b8a-4c16-ad9d-72e5630f2b68 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "DELETE /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 204 len: 0 microversion: 2.1 time: 0.148733 Oct 04 09:05:01.694239 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 613/1179] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:05:01 2022] DELETE /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:05:01.703129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9a499f3b-6abe-4e5c-ab0b-c7922c74c149 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:01.703958 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9a499f3b-6abe-4e5c-ab0b-c7922c74c149 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:01.710490 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a499f3b-6abe-4e5c-ab0b-c7922c74c149 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:01.711101 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a499f3b-6abe-4e5c-ab0b-c7922c74c149 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:01.711613 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a499f3b-6abe-4e5c-ab0b-c7922c74c149 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:01.712630 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a499f3b-6abe-4e5c-ab0b-c7922c74c149 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:01.713152 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a499f3b-6abe-4e5c-ab0b-c7922c74c149 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:01.713648 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9a499f3b-6abe-4e5c-ab0b-c7922c74c149 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:01.849140 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9a499f3b-6abe-4e5c-ab0b-c7922c74c149 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:01.857426 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9a499f3b-6abe-4e5c-ab0b-c7922c74c149 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1575 microversion: 2.1 time: 0.158587 Oct 04 09:05:01.858062 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 567/1180] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:01 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:01.951049 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-898bdb52-f16e-42ec-89f5-d4740286979d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:01.951867 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-898bdb52-f16e-42ec-89f5-d4740286979d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:01.958141 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-898bdb52-f16e-42ec-89f5-d4740286979d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:01.958592 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-898bdb52-f16e-42ec-89f5-d4740286979d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:01.959257 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-898bdb52-f16e-42ec-89f5-d4740286979d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:01.959992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-898bdb52-f16e-42ec-89f5-d4740286979d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:01.960427 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-898bdb52-f16e-42ec-89f5-d4740286979d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:01.960850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-898bdb52-f16e-42ec-89f5-d4740286979d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:02.096839 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-898bdb52-f16e-42ec-89f5-d4740286979d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:02.104564 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-898bdb52-f16e-42ec-89f5-d4740286979d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1368 microversion: 2.1 time: 0.158178 Oct 04 09:05:02.105188 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 614/1181] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:01 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:02.886036 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f46459af-ad57-4400-a270-3c99352d98d6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:02.887025 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f46459af-ad57-4400-a270-3c99352d98d6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:02.889886 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=6 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:02.890570 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:02.897137 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f46459af-ad57-4400-a270-3c99352d98d6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:02.897626 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f46459af-ad57-4400-a270-3c99352d98d6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:02.898090 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f46459af-ad57-4400-a270-3c99352d98d6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:02.898814 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f46459af-ad57-4400-a270-3c99352d98d6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:02.899349 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f46459af-ad57-4400-a270-3c99352d98d6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:02.899764 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f46459af-ad57-4400-a270-3c99352d98d6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:03.034928 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f46459af-ad57-4400-a270-3c99352d98d6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:03.043910 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f46459af-ad57-4400-a270-3c99352d98d6 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1575 microversion: 2.1 time: 0.164405 Oct 04 09:05:03.044493 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 568/1182] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:02 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:03.128715 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8709ba74-044f-43b0-ba38-d3a2f2fc796d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:03.129947 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8709ba74-044f-43b0-ba38-d3a2f2fc796d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:03.132325 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:03.132992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=6 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:03.139085 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8709ba74-044f-43b0-ba38-d3a2f2fc796d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:03.139511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8709ba74-044f-43b0-ba38-d3a2f2fc796d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:03.139962 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8709ba74-044f-43b0-ba38-d3a2f2fc796d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:03.140668 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8709ba74-044f-43b0-ba38-d3a2f2fc796d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:03.141513 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8709ba74-044f-43b0-ba38-d3a2f2fc796d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:03.142121 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8709ba74-044f-43b0-ba38-d3a2f2fc796d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:03.289852 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8709ba74-044f-43b0-ba38-d3a2f2fc796d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:03.301552 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8709ba74-044f-43b0-ba38-d3a2f2fc796d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1368 microversion: 2.1 time: 0.176449 Oct 04 09:05:03.302327 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 615/1183] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:03 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:04.067529 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-87be80b5-0e61-4885-b4a2-dd12eaf75394 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:04.068163 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-87be80b5-0e61-4885-b4a2-dd12eaf75394 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:04.074731 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87be80b5-0e61-4885-b4a2-dd12eaf75394 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:04.075251 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87be80b5-0e61-4885-b4a2-dd12eaf75394 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:04.075801 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87be80b5-0e61-4885-b4a2-dd12eaf75394 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:04.076518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87be80b5-0e61-4885-b4a2-dd12eaf75394 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:04.076963 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87be80b5-0e61-4885-b4a2-dd12eaf75394 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:04.077379 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-87be80b5-0e61-4885-b4a2-dd12eaf75394 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:04.149398 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-578a980e-c733-436f-9239-b856ce1abca4 req-44f862d1-b775-410f-ae0e-4568d9b715ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61244f16-1483-4d31-a6de-0d4689a62479", "name": "network-vif-deleted", "tag": "ad67ba62-fb95-40fd-bf8f-f28d45c2e22f"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:05:04.150039 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-87be80b5-0e61-4885-b4a2-dd12eaf75394 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:04.159367 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-578a980e-c733-436f-9239-b856ce1abca4 req-44f862d1-b775-410f-ae0e-4568d9b715ba service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:04.159594 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-87be80b5-0e61-4885-b4a2-dd12eaf75394 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1391 microversion: 2.1 time: 0.096237 Oct 04 09:05:04.159850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-578a980e-c733-436f-9239-b856ce1abca4 req-44f862d1-b775-410f-ae0e-4568d9b715ba service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:04.160019 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 569/1184] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:04 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1391 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:04.160314 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-578a980e-c733-436f-9239-b856ce1abca4 req-44f862d1-b775-410f-ae0e-4568d9b715ba service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:04.172198 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-578a980e-c733-436f-9239-b856ce1abca4 req-44f862d1-b775-410f-ae0e-4568d9b715ba service nova] Creating event network-vif-deleted:ad67ba62-fb95-40fd-bf8f-f28d45c2e22f for instance 61244f16-1483-4d31-a6de-0d4689a62479 on hv-cinder-84456 Oct 04 09:05:04.176948 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-578a980e-c733-436f-9239-b856ce1abca4 req-44f862d1-b775-410f-ae0e-4568d9b715ba service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031265 Oct 04 09:05:04.177765 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 616/1185] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 09:05:04.326922 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2ede8936-6a68-4be0-83b5-35c1ac344dbe tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:04.327537 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2ede8936-6a68-4be0-83b5-35c1ac344dbe tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:04.333993 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ede8936-6a68-4be0-83b5-35c1ac344dbe tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:04.334477 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ede8936-6a68-4be0-83b5-35c1ac344dbe tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:04.334931 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ede8936-6a68-4be0-83b5-35c1ac344dbe tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:04.335607 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ede8936-6a68-4be0-83b5-35c1ac344dbe tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:04.336097 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ede8936-6a68-4be0-83b5-35c1ac344dbe tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:04.336525 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2ede8936-6a68-4be0-83b5-35c1ac344dbe tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:04.471441 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2ede8936-6a68-4be0-83b5-35c1ac344dbe tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:04.479319 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2ede8936-6a68-4be0-83b5-35c1ac344dbe tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1368 microversion: 2.1 time: 0.156322 Oct 04 09:05:04.489978 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 570/1186] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:04 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:04.686683 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-2c8e0d58-e63e-4e6e-955c-018f9b6a83ed req-e26ac9a5-f3d7-4582-ae31-022a0b3ccb4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3857fa0e-9f45-4f4f-91e4-565557da917e", "name": "network-vif-plugged", "status": "completed", "tag": "0000397c-08c2-4f58-a8d6-470a8aa92e02"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:05:04.698208 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-2c8e0d58-e63e-4e6e-955c-018f9b6a83ed req-e26ac9a5-f3d7-4582-ae31-022a0b3ccb4c service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:04.698901 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-2c8e0d58-e63e-4e6e-955c-018f9b6a83ed req-e26ac9a5-f3d7-4582-ae31-022a0b3ccb4c service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:04.699530 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-2c8e0d58-e63e-4e6e-955c-018f9b6a83ed req-e26ac9a5-f3d7-4582-ae31-022a0b3ccb4c service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:04.717690 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-2c8e0d58-e63e-4e6e-955c-018f9b6a83ed req-e26ac9a5-f3d7-4582-ae31-022a0b3ccb4c service nova] Creating event network-vif-plugged:0000397c-08c2-4f58-a8d6-470a8aa92e02 for instance 3857fa0e-9f45-4f4f-91e4-565557da917e on hv-cinder-84456 Oct 04 09:05:04.725121 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-2c8e0d58-e63e-4e6e-955c-018f9b6a83ed req-e26ac9a5-f3d7-4582-ae31-022a0b3ccb4c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042995 Oct 04 09:05:04.725700 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 617/1187] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:05:05.182635 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e88afbe1-2cff-4046-bdd9-99b157d79c82 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:05.183285 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e88afbe1-2cff-4046-bdd9-99b157d79c82 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:05.190364 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e88afbe1-2cff-4046-bdd9-99b157d79c82 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:05.190364 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e88afbe1-2cff-4046-bdd9-99b157d79c82 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:05.190364 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e88afbe1-2cff-4046-bdd9-99b157d79c82 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:05.192080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e88afbe1-2cff-4046-bdd9-99b157d79c82 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:05.192534 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e88afbe1-2cff-4046-bdd9-99b157d79c82 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:05.192933 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e88afbe1-2cff-4046-bdd9-99b157d79c82 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:05.224969 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e88afbe1-2cff-4046-bdd9-99b157d79c82 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:05.225756 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e88afbe1-2cff-4046-bdd9-99b157d79c82 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:05.226351 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e88afbe1-2cff-4046-bdd9-99b157d79c82 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:05.226964 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-e88afbe1-2cff-4046-bdd9-99b157d79c82 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lazy-loading 'fault' on Instance uuid 61244f16-1483-4d31-a6de-0d4689a62479 {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:05:05.274093 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e88afbe1-2cff-4046-bdd9-99b157d79c82 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d329978baf425e954b9965ae0cb652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881a40342cb84608b961e6b32dceadb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:05.281325 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e88afbe1-2cff-4046-bdd9-99b157d79c82 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 200 len: 1184 microversion: 2.1 time: 0.102622 Oct 04 09:05:05.281890 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 571/1188] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:05 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 1184 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:05.508057 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-46e65f7a-fd86-4dcf-8d2e-4252a7f895bd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:05.509081 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-46e65f7a-fd86-4dcf-8d2e-4252a7f895bd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:05.519636 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-46e65f7a-fd86-4dcf-8d2e-4252a7f895bd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:05.520481 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-46e65f7a-fd86-4dcf-8d2e-4252a7f895bd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:05.521236 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-46e65f7a-fd86-4dcf-8d2e-4252a7f895bd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:05.522368 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-46e65f7a-fd86-4dcf-8d2e-4252a7f895bd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:05.523127 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-46e65f7a-fd86-4dcf-8d2e-4252a7f895bd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:05.523825 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-46e65f7a-fd86-4dcf-8d2e-4252a7f895bd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:05.661316 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-46e65f7a-fd86-4dcf-8d2e-4252a7f895bd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:05.669321 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-46e65f7a-fd86-4dcf-8d2e-4252a7f895bd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1368 microversion: 2.1 time: 0.169245 Oct 04 09:05:05.669903 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 618/1189] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:05 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:06.308404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-93dec9f8-5cb2-49c8-b38e-1b38894c180a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:06.309397 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-93dec9f8-5cb2-49c8-b38e-1b38894c180a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: 61244f16-1483-4d31-a6de-0d4689a62479] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:06.320422 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93dec9f8-5cb2-49c8-b38e-1b38894c180a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:06.321230 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93dec9f8-5cb2-49c8-b38e-1b38894c180a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:06.321965 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93dec9f8-5cb2-49c8-b38e-1b38894c180a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:06.323154 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93dec9f8-5cb2-49c8-b38e-1b38894c180a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:06.323923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93dec9f8-5cb2-49c8-b38e-1b38894c180a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:06.324648 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-93dec9f8-5cb2-49c8-b38e-1b38894c180a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:06.339051 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-93dec9f8-5cb2-49c8-b38e-1b38894c180a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] HTTP exception thrown: Instance 61244f16-1483-4d31-a6de-0d4689a62479 could not be found. Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-93dec9f8-5cb2-49c8-b38e-1b38894c180a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Request method failure captured: Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 HTTP/1.1 Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_TpG0P4hrI1_riDYCW34KMWgw3k8HzWWKQDWZN4OA7RwjFaVPPOlXJSC-4IxVkb5V0kx6OTMIVCK1VD-olX742a5fy61d1gJWzFSirdCfTUBSR7vb70g_ixOkSOfBAkkMSQxADOoP_L5-osTW9aLSB530f2shfykqfUZLOGXpEJtZI Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 881a40342cb84608b961e6b32dceadb4 Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-TestVolumeBootPattern-2116967592 Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:05:06.340737 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:05:06.342374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_881a40342cb84608b961e6b32dceadb4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/881a40342cb84608b961e6b32dceadb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/881a40342cb84608b961e6b32dceadb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/881a40342cb84608b961e6b32dceadb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:05:06.342374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-TestVolumeBootPattern-2116967592 Oct 04 09:05:06.342374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 881a40342cb84608b961e6b32dceadb4 Oct 04 09:05:06.342374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116967592 Oct 04 09:05:06.342374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-TestVolumeBootPattern-2116967592-project Oct 04 09:05:06.342374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:05:06.342374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:05:06.342374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: d8d329978baf425e954b9965ae0cb652 Oct 04 09:05:06.342374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-TestVolumeBootPattern-2116967592-project Oct 04 09:05:06.342374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:05:06.342374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance 61244f16-1483-4d31-a6de-0d4689a62479 could not be found. Oct 04 09:05:06.342374 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': '61244f16-1483-4d31-a6de-0d4689a62479'} Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61244f16-1483-4d31-a6de-0d4689a62479 could not be found. Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:05:06.343327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61244f16-1483-4d31-a6de-0d4689a62479 could not be found. Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61244f16-1483-4d31-a6de-0d4689a62479 could not be found. Oct 04 09:05:06.344923 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:05:06.346524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-93dec9f8-5cb2-49c8-b38e-1b38894c180a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Returning 404 to user: Instance 61244f16-1483-4d31-a6de-0d4689a62479 could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:05:06.346524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-93dec9f8-5cb2-49c8-b38e-1b38894c180a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479" status: 404 len: 111 microversion: 2.1 time: 0.040307 Oct 04 09:05:06.346524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 572/1190] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:06 2022] GET /compute/v2.1/servers/61244f16-1483-4d31-a6de-0d4689a62479 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:05:06.692638 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-2860a2b6-5d0d-44af-9b05-910820f232c9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:06.693254 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-2860a2b6-5d0d-44af-9b05-910820f232c9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:06.700205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2860a2b6-5d0d-44af-9b05-910820f232c9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:06.700692 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2860a2b6-5d0d-44af-9b05-910820f232c9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:06.701122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2860a2b6-5d0d-44af-9b05-910820f232c9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:06.701828 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2860a2b6-5d0d-44af-9b05-910820f232c9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:06.702253 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2860a2b6-5d0d-44af-9b05-910820f232c9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:06.702664 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-2860a2b6-5d0d-44af-9b05-910820f232c9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:06.837825 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-2860a2b6-5d0d-44af-9b05-910820f232c9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:06.846126 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-2860a2b6-5d0d-44af-9b05-910820f232c9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1368 microversion: 2.1 time: 0.157524 Oct 04 09:05:06.846745 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 619/1191] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:06 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:07.064356 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c10e931a-72cf-42a7-b9f7-c903933372b3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:07.064854 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c10e931a-72cf-42a7-b9f7-c903933372b3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:07.071130 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c10e931a-72cf-42a7-b9f7-c903933372b3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:07.071622 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c10e931a-72cf-42a7-b9f7-c903933372b3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:07.072095 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c10e931a-72cf-42a7-b9f7-c903933372b3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:07.072804 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c10e931a-72cf-42a7-b9f7-c903933372b3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:07.073256 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c10e931a-72cf-42a7-b9f7-c903933372b3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:07.073680 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c10e931a-72cf-42a7-b9f7-c903933372b3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:07.088677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-c10e931a-72cf-42a7-b9f7-c903933372b3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] HTTP exception thrown: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c10e931a-72cf-42a7-b9f7-c903933372b3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Request method failure captured: Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: DELETE /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 HTTP/1.1 Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_TpG0P4hrI1_riDYCW34KMWgw3k8HzWWKQDWZN4OA7RwjFaVPPOlXJSC-4IxVkb5V0kx6OTMIVCK1VD-olX742a5fy61d1gJWzFSirdCfTUBSR7vb70g_ixOkSOfBAkkMSQxADOoP_L5-osTW9aLSB530f2shfykqfUZLOGXpEJtZI Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 881a40342cb84608b961e6b32dceadb4 Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-TestVolumeBootPattern-2116967592 Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:05:07.090689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:05:07.092315 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_881a40342cb84608b961e6b32dceadb4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/881a40342cb84608b961e6b32dceadb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/881a40342cb84608b961e6b32dceadb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/881a40342cb84608b961e6b32dceadb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:05:07.092315 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-TestVolumeBootPattern-2116967592 Oct 04 09:05:07.092315 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 881a40342cb84608b961e6b32dceadb4 Oct 04 09:05:07.092315 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116967592 Oct 04 09:05:07.092315 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-TestVolumeBootPattern-2116967592-project Oct 04 09:05:07.092315 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:05:07.092315 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:05:07.092315 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: d8d329978baf425e954b9965ae0cb652 Oct 04 09:05:07.092315 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-TestVolumeBootPattern-2116967592-project Oct 04 09:05:07.092315 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:05:07.092315 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. Oct 04 09:05:07.092315 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': 'c126bbd8-579f-48ce-88d5-29b61bd75c28'} Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:05:07.093198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. Oct 04 09:05:07.095138 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:05:07.098456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c10e931a-72cf-42a7-b9f7-c903933372b3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Returning 404 to user: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:05:07.098456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c10e931a-72cf-42a7-b9f7-c903933372b3 tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 404 len: 111 microversion: 2.1 time: 0.032813 Oct 04 09:05:07.098456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 573/1192] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:05:07 2022] DELETE /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:05:07.102679 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6a49d81e-1433-41d5-b5b8-c77cc259887e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:07.103289 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6a49d81e-1433-41d5-b5b8-c77cc259887e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] [instance: c126bbd8-579f-48ce-88d5-29b61bd75c28] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:07.109694 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6a49d81e-1433-41d5-b5b8-c77cc259887e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:07.110169 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6a49d81e-1433-41d5-b5b8-c77cc259887e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:07.110601 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6a49d81e-1433-41d5-b5b8-c77cc259887e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:07.111309 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6a49d81e-1433-41d5-b5b8-c77cc259887e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:07.111756 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6a49d81e-1433-41d5-b5b8-c77cc259887e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:07.112229 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6a49d81e-1433-41d5-b5b8-c77cc259887e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:07.125837 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-6a49d81e-1433-41d5-b5b8-c77cc259887e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] HTTP exception thrown: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6a49d81e-1433-41d5-b5b8-c77cc259887e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Request method failure captured: Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 HTTP/1.1 Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_TpG0P4hrI1_riDYCW34KMWgw3k8HzWWKQDWZN4OA7RwjFaVPPOlXJSC-4IxVkb5V0kx6OTMIVCK1VD-olX742a5fy61d1gJWzFSirdCfTUBSR7vb70g_ixOkSOfBAkkMSQxADOoP_L5-osTW9aLSB530f2shfykqfUZLOGXpEJtZI Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 881a40342cb84608b961e6b32dceadb4 Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-TestVolumeBootPattern-2116967592 Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:05:07.127508 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:05:07.129720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_881a40342cb84608b961e6b32dceadb4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/881a40342cb84608b961e6b32dceadb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/881a40342cb84608b961e6b32dceadb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/881a40342cb84608b961e6b32dceadb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:05:07.129720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-TestVolumeBootPattern-2116967592 Oct 04 09:05:07.129720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 881a40342cb84608b961e6b32dceadb4 Oct 04 09:05:07.129720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116967592 Oct 04 09:05:07.129720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-TestVolumeBootPattern-2116967592-project Oct 04 09:05:07.129720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:05:07.129720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:05:07.129720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: d8d329978baf425e954b9965ae0cb652 Oct 04 09:05:07.129720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-TestVolumeBootPattern-2116967592-project Oct 04 09:05:07.129720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:05:07.129720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. Oct 04 09:05:07.129720 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': 'c126bbd8-579f-48ce-88d5-29b61bd75c28'} Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:05:07.130681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. Oct 04 09:05:07.132362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:05:07.133861 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6a49d81e-1433-41d5-b5b8-c77cc259887e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Returning 404 to user: Instance c126bbd8-579f-48ce-88d5-29b61bd75c28 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:05:07.133861 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6a49d81e-1433-41d5-b5b8-c77cc259887e tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28" status: 404 len: 111 microversion: 2.1 time: 0.030833 Oct 04 09:05:07.133861 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 620/1193] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:07 2022] GET /compute/v2.1/servers/c126bbd8-579f-48ce-88d5-29b61bd75c28 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:05:07.870127 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-80d948bc-b34e-44ee-81fb-36db5ed51b8b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:07.870743 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-80d948bc-b34e-44ee-81fb-36db5ed51b8b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:07.877670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80d948bc-b34e-44ee-81fb-36db5ed51b8b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:07.878150 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80d948bc-b34e-44ee-81fb-36db5ed51b8b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:07.878589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80d948bc-b34e-44ee-81fb-36db5ed51b8b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:07.879276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80d948bc-b34e-44ee-81fb-36db5ed51b8b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:07.879729 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80d948bc-b34e-44ee-81fb-36db5ed51b8b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:07.880185 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-80d948bc-b34e-44ee-81fb-36db5ed51b8b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:08.014129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-80d948bc-b34e-44ee-81fb-36db5ed51b8b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:08.022426 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-80d948bc-b34e-44ee-81fb-36db5ed51b8b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1558 microversion: 2.1 time: 0.156610 Oct 04 09:05:08.023013 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 574/1194] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:07 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:08.044674 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-719d0a4e-f471-4f53-90e6-bfc39a0d0503 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:08.045194 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-719d0a4e-f471-4f53-90e6-bfc39a0d0503 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:08.051924 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-719d0a4e-f471-4f53-90e6-bfc39a0d0503 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:08.052410 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-719d0a4e-f471-4f53-90e6-bfc39a0d0503 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:08.052838 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-719d0a4e-f471-4f53-90e6-bfc39a0d0503 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:08.053515 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-719d0a4e-f471-4f53-90e6-bfc39a0d0503 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:08.053961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-719d0a4e-f471-4f53-90e6-bfc39a0d0503 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:08.054372 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-719d0a4e-f471-4f53-90e6-bfc39a0d0503 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:08.140464 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-719d0a4e-f471-4f53-90e6-bfc39a0d0503 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099706 Oct 04 09:05:08.141069 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 621/1195] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Oct 4 09:05:08 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:05:08.432067 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8565f761-c708-4c9f-960b-134b7027c53a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] Calling method '.version_select at 0x7ff92e31d5e0>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:08.462350 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8565f761-c708-4c9f-960b-134b7027c53a tempest-TestVolumeBootPattern-2116967592 tempest-TestVolumeBootPattern-2116967592-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2035428488" status: 202 len: 0 microversion: 2.1 time: 0.037167 Oct 04 09:05:08.462956 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 575/1196] 10.222.0.44 () {58 vars in 1263 bytes} [Tue Oct 4 09:05:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2035428488 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:05:09.089212 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-298344ac-d6a0-4713-920d-73cb188df568 req-c4c69e06-607c-4b53-b759-e452ef959fdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3857fa0e-9f45-4f4f-91e4-565557da917e", "tag": "0000397c-08c2-4f58-a8d6-470a8aa92e02"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:05:09.098829 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-298344ac-d6a0-4713-920d-73cb188df568 req-c4c69e06-607c-4b53-b759-e452ef959fdb service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:09.099300 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-298344ac-d6a0-4713-920d-73cb188df568 req-c4c69e06-607c-4b53-b759-e452ef959fdb service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:09.099723 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-298344ac-d6a0-4713-920d-73cb188df568 req-c4c69e06-607c-4b53-b759-e452ef959fdb service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:09.110750 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-298344ac-d6a0-4713-920d-73cb188df568 req-c4c69e06-607c-4b53-b759-e452ef959fdb service nova] Creating event network-changed:0000397c-08c2-4f58-a8d6-470a8aa92e02 for instance 3857fa0e-9f45-4f4f-91e4-565557da917e on hv-cinder-84456 Oct 04 09:05:09.116123 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-298344ac-d6a0-4713-920d-73cb188df568 req-c4c69e06-607c-4b53-b759-e452ef959fdb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030691 Oct 04 09:05:09.117061 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 622/1197] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:06:24.154392 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=54 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:24.155567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:24.164163 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4a3aa412-3f5a-4c99-9e69-921154fc2a0c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:24.164981 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4a3aa412-3f5a-4c99-9e69-921154fc2a0c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:24.176487 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4a3aa412-3f5a-4c99-9e69-921154fc2a0c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:24.177290 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4a3aa412-3f5a-4c99-9e69-921154fc2a0c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:24.178012 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4a3aa412-3f5a-4c99-9e69-921154fc2a0c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:24.179150 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4a3aa412-3f5a-4c99-9e69-921154fc2a0c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:24.179951 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4a3aa412-3f5a-4c99-9e69-921154fc2a0c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:24.180677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4a3aa412-3f5a-4c99-9e69-921154fc2a0c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:24.205932 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4a3aa412-3f5a-4c99-9e69-921154fc2a0c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e/ips" status: 200 len: 150 microversion: 2.1 time: 0.055088 Oct 04 09:06:24.206495 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 576/1198] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Oct 4 09:06:24 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e/ips => generated 150 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:06:24.218897 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:24.219575 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:24.220790 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 09:06:24.220976 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Tue Oct 4 09:06:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e/os-volume_attachments (ip 10.222.0.44) !!! Oct 04 09:06:24.226838 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5ad295e0-ee9b-45f3-9158-88efc7c4a0b5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73281869-bfda-4350-92b5-be4d62ac425e"}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:06:24.229308 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5ad295e0-ee9b-45f3-9158-88efc7c4a0b5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:24.238968 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5ad295e0-ee9b-45f3-9158-88efc7c4a0b5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:24.239448 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5ad295e0-ee9b-45f3-9158-88efc7c4a0b5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:24.240246 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5ad295e0-ee9b-45f3-9158-88efc7c4a0b5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:24.240944 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5ad295e0-ee9b-45f3-9158-88efc7c4a0b5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:24.241391 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5ad295e0-ee9b-45f3-9158-88efc7c4a0b5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:24.241811 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5ad295e0-ee9b-45f3-9158-88efc7c4a0b5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:24.330747 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-5ad295e0-ee9b-45f3-9158-88efc7c4a0b5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] HTTP exception thrown: Invalid volume: volume 73281869-bfda-4350-92b5-be4d62ac425e is already attached to instances: 234fb5e1-513f-4c6e-bce8-43580ed70303 Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5ad295e0-ee9b-45f3-9158-88efc7c4a0b5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Request method failure captured: Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: POST /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e/os-volume_attachments HTTP/1.1 Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 74 Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_bNdsNoR1EJ0YryrP3LxGOA4CSKhOV3N2YTX5dRZGWbSMozvy9Uq2nzgH9fYhwhF5fUR2ahiSmulkP-Pv3i4rylMex1AwqCGffErBnDQcsWSLyokVVRtYTA5obgs2izUVEr7P4VXXwmn8LiZUH2LRl7KuHI9xyIQSl2BhPVU8SoXAk Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:06:24.332531 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:06:24.334266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89b56ee603d34a5f85f7e007b2fe668f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:06:24.334266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:06:24.334266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:06:24.334266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:06:24.334266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:06:24.334266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:06:24.334266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:06:24.334266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 3ec88da1704d44fb924fa3cc04e5fe25 Oct 04 09:06:24.334266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:06:24.334266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Oct 04 09:06:24.334266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {"volumeAttachment": {"volumeId": "73281869-bfda-4350-92b5-be4d62ac425e"}} Oct 04 09:06:24.334266 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Invalid volume: volume 73281869-bfda-4350-92b5-be4d62ac425e is already attached to instances: 234fb5e1-513f-4c6e-bce8-43580ed70303 Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'server_id': '3857fa0e-9f45-4f4f-91e4-565557da917e', 'body': {'volumeAttachment': {'volumeId': '73281869-bfda-4350-92b5-be4d62ac425e'}}} Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 73281869-bfda-4350-92b5-be4d62ac425e is already attached to instances: 234fb5e1-513f-4c6e-bce8-43580ed70303 Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:06:24.335589 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 73281869-bfda-4350-92b5-be4d62ac425e is already attached to instances: 234fb5e1-513f-4c6e-bce8-43580ed70303 Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:06:24.337305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:06:24.339109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:06:24.339109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:06:24.339109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:06:24.339109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 73281869-bfda-4350-92b5-be4d62ac425e is already attached to instances: 234fb5e1-513f-4c6e-bce8-43580ed70303 Oct 04 09:06:24.339109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:06:24.339109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5ad295e0-ee9b-45f3-9158-88efc7c4a0b5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Returning 400 to user: Invalid volume: volume 73281869-bfda-4350-92b5-be4d62ac425e is already attached to instances: 234fb5e1-513f-4c6e-bce8-43580ed70303 {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:06:24.339109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5ad295e0-ee9b-45f3-9158-88efc7c4a0b5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "POST /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117916 Oct 04 09:06:24.339109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 623/1199] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Oct 4 09:06:24 2022] POST /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 09:06:24.343158 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1ad12621-819c-4b8f-af25-beb7467af9b3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:24.343775 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1ad12621-819c-4b8f-af25-beb7467af9b3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:24.350157 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1ad12621-819c-4b8f-af25-beb7467af9b3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:24.350631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1ad12621-819c-4b8f-af25-beb7467af9b3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:24.351058 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1ad12621-819c-4b8f-af25-beb7467af9b3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:24.351741 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1ad12621-819c-4b8f-af25-beb7467af9b3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:24.352214 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1ad12621-819c-4b8f-af25-beb7467af9b3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:24.352632 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1ad12621-819c-4b8f-af25-beb7467af9b3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:24.377799 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1ad12621-819c-4b8f-af25-beb7467af9b3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Going to try to terminate instance {{(pid=142439) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:06:24.463388 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1ad12621-819c-4b8f-af25-beb7467af9b3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 204 len: 0 microversion: 2.1 time: 0.123894 Oct 04 09:06:24.464033 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 577/1200] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:06:24 2022] DELETE /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:06:24.472644 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4aa33f90-a49a-44ad-a5d0-ac0766cf7e96 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:24.473199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4aa33f90-a49a-44ad-a5d0-ac0766cf7e96 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:24.479296 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4aa33f90-a49a-44ad-a5d0-ac0766cf7e96 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:24.479782 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4aa33f90-a49a-44ad-a5d0-ac0766cf7e96 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:24.480242 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4aa33f90-a49a-44ad-a5d0-ac0766cf7e96 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:24.481061 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4aa33f90-a49a-44ad-a5d0-ac0766cf7e96 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:24.481510 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4aa33f90-a49a-44ad-a5d0-ac0766cf7e96 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:24.481929 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4aa33f90-a49a-44ad-a5d0-ac0766cf7e96 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:24.629105 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4aa33f90-a49a-44ad-a5d0-ac0766cf7e96 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:24.639913 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4aa33f90-a49a-44ad-a5d0-ac0766cf7e96 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1683 microversion: 2.1 time: 0.171518 Oct 04 09:06:24.640500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 624/1201] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:24 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:25.668494 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-dc15b5ee-7fe2-4c5d-aa26-0c9b7daa7a7b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:25.669663 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-dc15b5ee-7fe2-4c5d-aa26-0c9b7daa7a7b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:25.680509 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc15b5ee-7fe2-4c5d-aa26-0c9b7daa7a7b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:25.681311 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc15b5ee-7fe2-4c5d-aa26-0c9b7daa7a7b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:25.682042 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc15b5ee-7fe2-4c5d-aa26-0c9b7daa7a7b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:25.683366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc15b5ee-7fe2-4c5d-aa26-0c9b7daa7a7b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:25.684192 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc15b5ee-7fe2-4c5d-aa26-0c9b7daa7a7b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:25.685017 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-dc15b5ee-7fe2-4c5d-aa26-0c9b7daa7a7b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:25.823219 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-dc15b5ee-7fe2-4c5d-aa26-0c9b7daa7a7b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:25.831175 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-dc15b5ee-7fe2-4c5d-aa26-0c9b7daa7a7b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1683 microversion: 2.1 time: 0.169971 Oct 04 09:06:25.831749 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 578/1202] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:25 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:26.855000 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8a88caa4-53d8-4082-bb60-70a83383e52f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:26.855785 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8a88caa4-53d8-4082-bb60-70a83383e52f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:26.861822 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8a88caa4-53d8-4082-bb60-70a83383e52f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:26.862289 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8a88caa4-53d8-4082-bb60-70a83383e52f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:26.862729 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8a88caa4-53d8-4082-bb60-70a83383e52f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:26.863418 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8a88caa4-53d8-4082-bb60-70a83383e52f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:26.863859 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8a88caa4-53d8-4082-bb60-70a83383e52f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:26.864297 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8a88caa4-53d8-4082-bb60-70a83383e52f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:26.930744 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-8a88caa4-53d8-4082-bb60-70a83383e52f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:26.938647 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8a88caa4-53d8-4082-bb60-70a83383e52f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 200 len: 1615 microversion: 2.1 time: 0.087764 Oct 04 09:06:26.939201 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 625/1203] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:26 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:27.156953 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-b84dfc81-69fc-450d-9aa5-9f17cdea392d req-502f8ad6-d082-4c39-82a2-520db4da94ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3857fa0e-9f45-4f4f-91e4-565557da917e", "name": "network-vif-deleted", "tag": "0000397c-08c2-4f58-a8d6-470a8aa92e02"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:06:27.169342 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-b84dfc81-69fc-450d-9aa5-9f17cdea392d req-502f8ad6-d082-4c39-82a2-520db4da94ed service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:27.169810 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-b84dfc81-69fc-450d-9aa5-9f17cdea392d req-502f8ad6-d082-4c39-82a2-520db4da94ed service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:27.170241 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-b84dfc81-69fc-450d-9aa5-9f17cdea392d req-502f8ad6-d082-4c39-82a2-520db4da94ed service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:27.185796 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-b84dfc81-69fc-450d-9aa5-9f17cdea392d req-502f8ad6-d082-4c39-82a2-520db4da94ed service nova] Creating event network-vif-deleted:0000397c-08c2-4f58-a8d6-470a8aa92e02 for instance 3857fa0e-9f45-4f4f-91e4-565557da917e on hv-cinder-84456 Oct 04 09:06:27.191732 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-b84dfc81-69fc-450d-9aa5-9f17cdea392d req-502f8ad6-d082-4c39-82a2-520db4da94ed service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038583 Oct 04 09:06:27.192373 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 579/1204] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:06:27.964278 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6fd95c7f-8078-43e8-a511-e4b3ccc518d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:27.964890 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-6fd95c7f-8078-43e8-a511-e4b3ccc518d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:27.973326 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6fd95c7f-8078-43e8-a511-e4b3ccc518d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:27.973854 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6fd95c7f-8078-43e8-a511-e4b3ccc518d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:27.974286 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6fd95c7f-8078-43e8-a511-e4b3ccc518d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:27.975080 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6fd95c7f-8078-43e8-a511-e4b3ccc518d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:27.975421 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6fd95c7f-8078-43e8-a511-e4b3ccc518d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:27.975838 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-6fd95c7f-8078-43e8-a511-e4b3ccc518d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:27.991134 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-6fd95c7f-8078-43e8-a511-e4b3ccc518d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] HTTP exception thrown: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6fd95c7f-8078-43e8-a511-e4b3ccc518d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Request method failure captured: Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e HTTP/1.1 Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_bNdsNoR1EJ0YryrP3LxGOA4CSKhOV3N2YTX5dRZGWbSMozvy9Uq2nzgH9fYhwhF5fUR2ahiSmulkP-Pv3i4rylMex1AwqCGffErBnDQcsWSLyokVVRtYTA5obgs2izUVEr7P4VXXwmn8LiZUH2LRl7KuHI9xyIQSl2BhPVU8SoXAk Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:06:27.992953 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:06:27.994426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89b56ee603d34a5f85f7e007b2fe668f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:06:27.994426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:06:27.994426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:06:27.994426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:06:27.994426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:06:27.994426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:06:27.994426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:06:27.994426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 3ec88da1704d44fb924fa3cc04e5fe25 Oct 04 09:06:27.994426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:06:27.994426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:06:27.994426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. Oct 04 09:06:27.994426 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': '3857fa0e-9f45-4f4f-91e4-565557da917e'} Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:06:27.995298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. Oct 04 09:06:27.996713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:06:27.998056 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-6fd95c7f-8078-43e8-a511-e4b3ccc518d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Returning 404 to user: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:06:27.998056 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-6fd95c7f-8078-43e8-a511-e4b3ccc518d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 404 len: 111 microversion: 2.1 time: 0.034136 Oct 04 09:06:27.998056 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 626/1205] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:27 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:06:28.004203 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-916d677a-ad8c-4a1e-82ca-4f3ebf85a27d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '.version_select at 0x7ff92e5ca790>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:28.025496 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-916d677a-ad8c-4a1e-82ca-4f3ebf85a27d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1787488835" status: 202 len: 0 microversion: 2.1 time: 0.025586 Oct 04 09:06:28.026114 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 580/1206] 10.222.0.44 () {58 vars in 1221 bytes} [Tue Oct 4 09:06:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1787488835 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:06:28.709134 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-fb31dff9-cd1b-43bd-a877-4fdae39836cc tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:28.709629 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-fb31dff9-cd1b-43bd-a877-4fdae39836cc tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:28.718255 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fb31dff9-cd1b-43bd-a877-4fdae39836cc tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:28.719105 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fb31dff9-cd1b-43bd-a877-4fdae39836cc tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:28.719713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fb31dff9-cd1b-43bd-a877-4fdae39836cc tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:28.720879 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fb31dff9-cd1b-43bd-a877-4fdae39836cc tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:28.721637 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fb31dff9-cd1b-43bd-a877-4fdae39836cc tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:28.722217 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fb31dff9-cd1b-43bd-a877-4fdae39836cc tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:28.810698 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-fb31dff9-cd1b-43bd-a877-4fdae39836cc tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lazy-loading 'services' on Instance uuid 234fb5e1-513f-4c6e-bce8-43580ed70303 {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:06:28.894499 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-fb31dff9-cd1b-43bd-a877-4fdae39836cc tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "DELETE /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303/os-volume_attachments/73281869-bfda-4350-92b5-be4d62ac425e" status: 202 len: 0 microversion: 2.1 time: 0.189153 Oct 04 09:06:28.895103 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 627/1207] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Oct 4 09:06:28 2022] DELETE /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303/os-volume_attachments/73281869-bfda-4350-92b5-be4d62ac425e => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:06:28.903987 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d509d96d-9ac5-4b0f-bb66-cc8ebe7a29d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:28.906290 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d509d96d-9ac5-4b0f-bb66-cc8ebe7a29d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:28.913366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d509d96d-9ac5-4b0f-bb66-cc8ebe7a29d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:28.913904 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d509d96d-9ac5-4b0f-bb66-cc8ebe7a29d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:28.914379 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d509d96d-9ac5-4b0f-bb66-cc8ebe7a29d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:28.915073 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d509d96d-9ac5-4b0f-bb66-cc8ebe7a29d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:28.915516 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d509d96d-9ac5-4b0f-bb66-cc8ebe7a29d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:28.915965 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d509d96d-9ac5-4b0f-bb66-cc8ebe7a29d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:28.947246 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d509d96d-9ac5-4b0f-bb66-cc8ebe7a29d8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047669 Oct 04 09:06:28.947844 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 581/1208] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:06:28 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:06:29.964398 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0cd7add8-e2b9-4e50-8639-a239c1d396fd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:29.967175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0cd7add8-e2b9-4e50-8639-a239c1d396fd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:29.976703 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0cd7add8-e2b9-4e50-8639-a239c1d396fd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:29.977191 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0cd7add8-e2b9-4e50-8639-a239c1d396fd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:29.977674 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0cd7add8-e2b9-4e50-8639-a239c1d396fd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:29.978350 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0cd7add8-e2b9-4e50-8639-a239c1d396fd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:29.978915 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0cd7add8-e2b9-4e50-8639-a239c1d396fd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:29.979349 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0cd7add8-e2b9-4e50-8639-a239c1d396fd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:30.010063 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0cd7add8-e2b9-4e50-8639-a239c1d396fd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053635 Oct 04 09:06:30.010852 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 628/1209] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:06:29 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 09:06:30.078792 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-abb71e2c-c0ca-4cc6-91ab-53de0c2e50f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:30.079339 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-abb71e2c-c0ca-4cc6-91ab-53de0c2e50f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:30.085925 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-abb71e2c-c0ca-4cc6-91ab-53de0c2e50f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:30.086448 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-abb71e2c-c0ca-4cc6-91ab-53de0c2e50f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:30.086924 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-abb71e2c-c0ca-4cc6-91ab-53de0c2e50f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:30.087646 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-abb71e2c-c0ca-4cc6-91ab-53de0c2e50f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:30.088157 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-abb71e2c-c0ca-4cc6-91ab-53de0c2e50f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:30.088577 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-abb71e2c-c0ca-4cc6-91ab-53de0c2e50f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:30.114520 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-abb71e2c-c0ca-4cc6-91ab-53de0c2e50f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Going to try to terminate instance {{(pid=142439) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:06:30.195044 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-abb71e2c-c0ca-4cc6-91ab-53de0c2e50f3 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "DELETE /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 204 len: 0 microversion: 2.1 time: 0.119763 Oct 04 09:06:30.195562 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 582/1210] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:06:30 2022] DELETE /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:06:30.204388 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b9d582e6-2328-42c2-bdf1-a8a5e2a73304 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:30.205004 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b9d582e6-2328-42c2-bdf1-a8a5e2a73304 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:30.211221 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9d582e6-2328-42c2-bdf1-a8a5e2a73304 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:30.211702 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9d582e6-2328-42c2-bdf1-a8a5e2a73304 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:30.212170 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9d582e6-2328-42c2-bdf1-a8a5e2a73304 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:30.212861 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9d582e6-2328-42c2-bdf1-a8a5e2a73304 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:30.213313 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9d582e6-2328-42c2-bdf1-a8a5e2a73304 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:30.213740 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b9d582e6-2328-42c2-bdf1-a8a5e2a73304 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:30.354242 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-b9d582e6-2328-42c2-bdf1-a8a5e2a73304 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:30.362857 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b9d582e6-2328-42c2-bdf1-a8a5e2a73304 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 200 len: 1682 microversion: 2.1 time: 0.162429 Oct 04 09:06:30.363467 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 629/1211] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:30 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:06:31.392141 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e3202f1f-8c6d-460c-b659-ba9d604af6cf tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:31.393294 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e3202f1f-8c6d-460c-b659-ba9d604af6cf tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:31.404421 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e3202f1f-8c6d-460c-b659-ba9d604af6cf tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:31.405276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e3202f1f-8c6d-460c-b659-ba9d604af6cf tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:31.405988 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e3202f1f-8c6d-460c-b659-ba9d604af6cf tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:31.407132 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e3202f1f-8c6d-460c-b659-ba9d604af6cf tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:31.407819 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e3202f1f-8c6d-460c-b659-ba9d604af6cf tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:31.408276 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e3202f1f-8c6d-460c-b659-ba9d604af6cf tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:31.540944 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e3202f1f-8c6d-460c-b659-ba9d604af6cf tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:31.549162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e3202f1f-8c6d-460c-b659-ba9d604af6cf tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 200 len: 1682 microversion: 2.1 time: 0.164170 Oct 04 09:06:31.549752 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 583/1212] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:31 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:32.572830 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d6c620d2-3b88-4127-95d6-9b24392508f7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:32.573428 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d6c620d2-3b88-4127-95d6-9b24392508f7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:32.580314 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d6c620d2-3b88-4127-95d6-9b24392508f7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:32.580803 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d6c620d2-3b88-4127-95d6-9b24392508f7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:32.581238 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d6c620d2-3b88-4127-95d6-9b24392508f7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:32.581978 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d6c620d2-3b88-4127-95d6-9b24392508f7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:32.582442 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d6c620d2-3b88-4127-95d6-9b24392508f7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:32.582939 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d6c620d2-3b88-4127-95d6-9b24392508f7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:32.718624 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d6c620d2-3b88-4127-95d6-9b24392508f7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:32.732896 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d6c620d2-3b88-4127-95d6-9b24392508f7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 200 len: 1682 microversion: 2.1 time: 0.163911 Oct 04 09:06:32.734353 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 630/1213] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:32 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:33.268430 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-f2bd6c7c-9e9b-4871-b290-4114dff8f1ff req-665854ed-b7ce-4b57-9786-03dbd8a47a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "234fb5e1-513f-4c6e-bce8-43580ed70303", "name": "network-vif-deleted", "tag": "846bf3ba-d84e-4e4b-808c-b00a72468afa"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:06:33.280533 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-f2bd6c7c-9e9b-4871-b290-4114dff8f1ff req-665854ed-b7ce-4b57-9786-03dbd8a47a44 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:33.280995 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-f2bd6c7c-9e9b-4871-b290-4114dff8f1ff req-665854ed-b7ce-4b57-9786-03dbd8a47a44 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:33.281589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-f2bd6c7c-9e9b-4871-b290-4114dff8f1ff req-665854ed-b7ce-4b57-9786-03dbd8a47a44 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:33.294233 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-f2bd6c7c-9e9b-4871-b290-4114dff8f1ff req-665854ed-b7ce-4b57-9786-03dbd8a47a44 service nova] Creating event network-vif-deleted:846bf3ba-d84e-4e4b-808c-b00a72468afa for instance 234fb5e1-513f-4c6e-bce8-43580ed70303 on hv-cinder-84456 Oct 04 09:06:33.299647 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-f2bd6c7c-9e9b-4871-b290-4114dff8f1ff req-665854ed-b7ce-4b57-9786-03dbd8a47a44 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035055 Oct 04 09:06:33.300828 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 584/1214] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:06:33.757998 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-27e2964b-126f-4cb8-90cf-a33850e94c5b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:33.759515 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-27e2964b-126f-4cb8-90cf-a33850e94c5b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:33.766807 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27e2964b-126f-4cb8-90cf-a33850e94c5b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:33.767400 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27e2964b-126f-4cb8-90cf-a33850e94c5b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:33.767830 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27e2964b-126f-4cb8-90cf-a33850e94c5b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:33.768557 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27e2964b-126f-4cb8-90cf-a33850e94c5b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:33.769023 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27e2964b-126f-4cb8-90cf-a33850e94c5b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:33.769419 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27e2964b-126f-4cb8-90cf-a33850e94c5b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:33.804558 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27e2964b-126f-4cb8-90cf-a33850e94c5b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:33.805212 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27e2964b-126f-4cb8-90cf-a33850e94c5b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:33.805643 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-27e2964b-126f-4cb8-90cf-a33850e94c5b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:33.806152 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-27e2964b-126f-4cb8-90cf-a33850e94c5b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lazy-loading 'fault' on Instance uuid 234fb5e1-513f-4c6e-bce8-43580ed70303 {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:06:34.080263 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-27e2964b-126f-4cb8-90cf-a33850e94c5b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:34.087812 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-27e2964b-126f-4cb8-90cf-a33850e94c5b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 200 len: 1330 microversion: 2.1 time: 0.333847 Oct 04 09:06:34.088484 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 631/1215] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:33 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 1330 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:35.116216 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8fb2faae-fca5-4a66-9d6e-a341f1670c62 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:35.117358 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8fb2faae-fca5-4a66-9d6e-a341f1670c62 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:35.127785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8fb2faae-fca5-4a66-9d6e-a341f1670c62 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:35.128300 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8fb2faae-fca5-4a66-9d6e-a341f1670c62 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:35.128736 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8fb2faae-fca5-4a66-9d6e-a341f1670c62 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:35.129421 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8fb2faae-fca5-4a66-9d6e-a341f1670c62 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:35.129865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8fb2faae-fca5-4a66-9d6e-a341f1670c62 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:35.130286 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8fb2faae-fca5-4a66-9d6e-a341f1670c62 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:35.143778 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-8fb2faae-fca5-4a66-9d6e-a341f1670c62 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] HTTP exception thrown: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8fb2faae-fca5-4a66-9d6e-a341f1670c62 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Request method failure captured: Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 HTTP/1.1 Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_bNdsNoR1EJ0YryrP3LxGOA4CSKhOV3N2YTX5dRZGWbSMozvy9Uq2nzgH9fYhwhF5fUR2ahiSmulkP-Pv3i4rylMex1AwqCGffErBnDQcsWSLyokVVRtYTA5obgs2izUVEr7P4VXXwmn8LiZUH2LRl7KuHI9xyIQSl2BhPVU8SoXAk Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:06:35.145423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:06:35.147080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89b56ee603d34a5f85f7e007b2fe668f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:06:35.147080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:06:35.147080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:06:35.147080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:06:35.147080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:06:35.147080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:06:35.147080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:06:35.147080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 3ec88da1704d44fb924fa3cc04e5fe25 Oct 04 09:06:35.147080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:06:35.147080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:06:35.147080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. Oct 04 09:06:35.147080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': '234fb5e1-513f-4c6e-bce8-43580ed70303'} Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:06:35.148079 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. Oct 04 09:06:35.149706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:06:35.151298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8fb2faae-fca5-4a66-9d6e-a341f1670c62 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Returning 404 to user: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:06:35.151298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8fb2faae-fca5-4a66-9d6e-a341f1670c62 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 404 len: 111 microversion: 2.1 time: 0.038064 Oct 04 09:06:35.151298 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 585/1216] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:35 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:06:35.155625 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7c150b45-2198-49a4-aaa5-1c3894983acc tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '.version_select at 0x7ff92e3e1670>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:35.181225 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7c150b45-2198-49a4-aaa5-1c3894983acc tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-747555053" status: 202 len: 0 microversion: 2.1 time: 0.029353 Oct 04 09:06:35.181787 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 632/1217] 10.222.0.44 () {58 vars in 1218 bytes} [Tue Oct 4 09:06:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-747555053 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:06:35.820046 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-3bee15c4-8322-4f4d-9bcb-430b4b569ebd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Action: 'create', calling method: .version_select at 0x7ff92e5ca310>, body: {"keypair": {"name": "tempest-keypair-2128623192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8DxZ3z7qpUzaAsNOm9DRZQeTf3X/SL2LUe0l5SyMMKZcFH1inlfBWMk+GkoLBagTJzGk5Mj6NOpwukeIma91x4AfjhMlxyt0Bbtarb2DQOOp4Z4JTTjcvoOx0/JJzxIA=="}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:06:35.835801 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-3bee15c4-8322-4f4d-9bcb-430b4b569ebd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:06:35.839875 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-3bee15c4-8322-4f4d-9bcb-430b4b569ebd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for user 3ec88da1704d44fb924fa3cc04e5fe25 and project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'key_pairs'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:06:35.864689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-3bee15c4-8322-4f4d-9bcb-430b4b569ebd tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048749 Oct 04 09:06:35.865658 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 586/1218] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Oct 4 09:06:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:06:37.210985 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1297066065", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20cff610-f8c7-446f-a4a5-54f1f06f39ee"}], "security_groups": [{"name": "tempest-securitygroup--740666857"}], "key_name": "tempest-keypair-2128623192", "user_data": "}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:06:37.319550 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.network.neutron [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] validate_networks() for [('20cff610-f8c7-446f-a4a5-54f1f06f39ee', None, None, None, None, None)] {{(pid=142438) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:06:37.708219 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Flavor limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:06:37.708640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Image limits 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:06:37.709109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Flavor pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:06:37.709509 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Image pref 0:0:0 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:06:37.709911 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.virt.hardware [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:06:37.719405 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:37.719934 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:37.720386 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:37.721084 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:37.721533 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:37.721945 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:37.739230 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:06:37.743556 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for user 3ec88da1704d44fb924fa3cc04e5fe25 and project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'instances', 'ram', 'cores'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:06:37.754932 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Going to run 1 instances... {{(pid=142438) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:06:37.757166 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142438) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:06:37.808091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-adbc5c38-f8d4-4060-b325-b84096f40d6e tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.602053 Oct 04 09:06:37.808910 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 633/1219] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 09:06:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 09:06:37.820127 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c3567081-60cc-49f0-a914-15f3d5b8ff71 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:37.820742 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c3567081-60cc-49f0-a914-15f3d5b8ff71 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:37.929076 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c3567081-60cc-49f0-a914-15f3d5b8ff71 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:37.936132 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c3567081-60cc-49f0-a914-15f3d5b8ff71 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 200 len: 1242 microversion: 2.1 time: 0.119960 Oct 04 09:06:37.936684 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 587/1220] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:37 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 1242 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:06:38.961414 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1429cd0e-e29d-418f-8701-f629ad2e70e9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:38.962270 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1429cd0e-e29d-418f-8701-f629ad2e70e9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:38.970669 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1429cd0e-e29d-418f-8701-f629ad2e70e9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:38.971157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1429cd0e-e29d-418f-8701-f629ad2e70e9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:38.971588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1429cd0e-e29d-418f-8701-f629ad2e70e9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:38.972619 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1429cd0e-e29d-418f-8701-f629ad2e70e9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:38.973073 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1429cd0e-e29d-418f-8701-f629ad2e70e9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:38.973490 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1429cd0e-e29d-418f-8701-f629ad2e70e9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:39.044308 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1429cd0e-e29d-418f-8701-f629ad2e70e9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:39.052009 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1429cd0e-e29d-418f-8701-f629ad2e70e9 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 200 len: 1302 microversion: 2.1 time: 0.096456 Oct 04 09:06:39.052807 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 634/1221] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:38 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 1302 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:40.074928 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d3710b84-6729-4c5d-9a08-e600afe743b7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:40.075549 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d3710b84-6729-4c5d-9a08-e600afe743b7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:40.082330 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d3710b84-6729-4c5d-9a08-e600afe743b7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:40.082823 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d3710b84-6729-4c5d-9a08-e600afe743b7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:40.083258 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d3710b84-6729-4c5d-9a08-e600afe743b7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:40.083990 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d3710b84-6729-4c5d-9a08-e600afe743b7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:40.084466 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d3710b84-6729-4c5d-9a08-e600afe743b7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:40.084892 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d3710b84-6729-4c5d-9a08-e600afe743b7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:40.220233 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d3710b84-6729-4c5d-9a08-e600afe743b7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:40.228075 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d3710b84-6729-4c5d-9a08-e600afe743b7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 200 len: 1367 microversion: 2.1 time: 0.157178 Oct 04 09:06:40.228651 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 588/1222] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:40 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:40.498806 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-a94e101f-52e6-4676-9cfe-d403b7c6f94e req-71be445b-7a8c-471f-abb0-a2274e6349e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d33b43-1430-4d89-a575-731a73a3f50a", "tag": "eb5e072f-d634-42c3-b6f6-1df5f304f30a"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:06:40.512142 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-a94e101f-52e6-4676-9cfe-d403b7c6f94e req-71be445b-7a8c-471f-abb0-a2274e6349e5 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:40.512408 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-a94e101f-52e6-4676-9cfe-d403b7c6f94e req-71be445b-7a8c-471f-abb0-a2274e6349e5 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:40.512640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-a94e101f-52e6-4676-9cfe-d403b7c6f94e req-71be445b-7a8c-471f-abb0-a2274e6349e5 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:40.524311 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-a94e101f-52e6-4676-9cfe-d403b7c6f94e req-71be445b-7a8c-471f-abb0-a2274e6349e5 service nova] Creating event network-changed:eb5e072f-d634-42c3-b6f6-1df5f304f30a for instance b1d33b43-1430-4d89-a575-731a73a3f50a on hv-cinder-84456 Oct 04 09:06:40.529492 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-a94e101f-52e6-4676-9cfe-d403b7c6f94e req-71be445b-7a8c-471f-abb0-a2274e6349e5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034888 Oct 04 09:06:40.530099 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 635/1223] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:06:41.255689 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-e30930ed-a6ee-4fb3-926b-d5d1b5daf4be tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:41.256629 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-e30930ed-a6ee-4fb3-926b-d5d1b5daf4be tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:41.267616 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e30930ed-a6ee-4fb3-926b-d5d1b5daf4be tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:41.268468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e30930ed-a6ee-4fb3-926b-d5d1b5daf4be tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:41.269198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e30930ed-a6ee-4fb3-926b-d5d1b5daf4be tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:41.270307 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e30930ed-a6ee-4fb3-926b-d5d1b5daf4be tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:41.271047 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e30930ed-a6ee-4fb3-926b-d5d1b5daf4be tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:41.271749 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-e30930ed-a6ee-4fb3-926b-d5d1b5daf4be tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:41.401160 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-e30930ed-a6ee-4fb3-926b-d5d1b5daf4be tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:41.409427 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-e30930ed-a6ee-4fb3-926b-d5d1b5daf4be tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 200 len: 1367 microversion: 2.1 time: 0.160403 Oct 04 09:06:41.409956 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 589/1224] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:41 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:42.443655 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e6babc4a-d1fb-408a-b163-1bf285fac413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:42.444810 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e6babc4a-d1fb-408a-b163-1bf285fac413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:42.455166 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6babc4a-d1fb-408a-b163-1bf285fac413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:42.455661 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6babc4a-d1fb-408a-b163-1bf285fac413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:42.456136 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6babc4a-d1fb-408a-b163-1bf285fac413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:42.456819 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6babc4a-d1fb-408a-b163-1bf285fac413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:42.457274 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6babc4a-d1fb-408a-b163-1bf285fac413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:42.457691 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e6babc4a-d1fb-408a-b163-1bf285fac413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:42.592591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e6babc4a-d1fb-408a-b163-1bf285fac413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:42.601032 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e6babc4a-d1fb-408a-b163-1bf285fac413 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 200 len: 1367 microversion: 2.1 time: 0.165336 Oct 04 09:06:42.601571 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 636/1225] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:42 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:43.628296 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-77e5fc16-6f85-4f5a-a8f7-e1065f62a235 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:43.629237 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-77e5fc16-6f85-4f5a-a8f7-e1065f62a235 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:43.640116 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-77e5fc16-6f85-4f5a-a8f7-e1065f62a235 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:43.640958 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-77e5fc16-6f85-4f5a-a8f7-e1065f62a235 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:43.641681 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-77e5fc16-6f85-4f5a-a8f7-e1065f62a235 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:43.642596 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-77e5fc16-6f85-4f5a-a8f7-e1065f62a235 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:43.643050 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-77e5fc16-6f85-4f5a-a8f7-e1065f62a235 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:43.643467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-77e5fc16-6f85-4f5a-a8f7-e1065f62a235 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:44.031580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-77e5fc16-6f85-4f5a-a8f7-e1065f62a235 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:44.040127 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-77e5fc16-6f85-4f5a-a8f7-e1065f62a235 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 200 len: 1367 microversion: 2.1 time: 0.418234 Oct 04 09:06:44.040696 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 590/1226] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:43 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 1367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:45.066485 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-67646344-da29-45a5-bdda-bafb76af5f99 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:45.067108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-67646344-da29-45a5-bdda-bafb76af5f99 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:45.073681 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67646344-da29-45a5-bdda-bafb76af5f99 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:45.074164 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67646344-da29-45a5-bdda-bafb76af5f99 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:45.074601 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67646344-da29-45a5-bdda-bafb76af5f99 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:45.075294 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67646344-da29-45a5-bdda-bafb76af5f99 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:45.075742 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67646344-da29-45a5-bdda-bafb76af5f99 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:45.076197 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-67646344-da29-45a5-bdda-bafb76af5f99 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:45.207804 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-67646344-da29-45a5-bdda-bafb76af5f99 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:45.216101 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-67646344-da29-45a5-bdda-bafb76af5f99 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 200 len: 1367 microversion: 2.1 time: 0.153563 Oct 04 09:06:45.216666 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 637/1227] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:45 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:46.241615 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-8ea537dc-c2b8-419c-b475-e45d8032be40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:46.242177 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-8ea537dc-c2b8-419c-b475-e45d8032be40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:46.249100 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8ea537dc-c2b8-419c-b475-e45d8032be40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:46.249583 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8ea537dc-c2b8-419c-b475-e45d8032be40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:46.250017 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8ea537dc-c2b8-419c-b475-e45d8032be40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:46.250708 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8ea537dc-c2b8-419c-b475-e45d8032be40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:46.251139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8ea537dc-c2b8-419c-b475-e45d8032be40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:46.251663 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-8ea537dc-c2b8-419c-b475-e45d8032be40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:46.384329 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-8ea537dc-c2b8-419c-b475-e45d8032be40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:46.392050 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-8ea537dc-c2b8-419c-b475-e45d8032be40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 200 len: 1367 microversion: 2.1 time: 0.155201 Oct 04 09:06:46.392620 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 591/1228] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:46 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:47.031544 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-b000098f-201a-4fa5-af8e-cc0b5e89a67d req-80911921-1079-4ff8-9d94-46183a21aaae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d33b43-1430-4d89-a575-731a73a3f50a", "name": "network-vif-plugged", "status": "completed", "tag": "eb5e072f-d634-42c3-b6f6-1df5f304f30a"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:06:47.041797 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-b000098f-201a-4fa5-af8e-cc0b5e89a67d req-80911921-1079-4ff8-9d94-46183a21aaae service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:47.042308 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-b000098f-201a-4fa5-af8e-cc0b5e89a67d req-80911921-1079-4ff8-9d94-46183a21aaae service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:47.042741 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-b000098f-201a-4fa5-af8e-cc0b5e89a67d req-80911921-1079-4ff8-9d94-46183a21aaae service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:47.054192 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-b000098f-201a-4fa5-af8e-cc0b5e89a67d req-80911921-1079-4ff8-9d94-46183a21aaae service nova] Creating event network-vif-plugged:eb5e072f-d634-42c3-b6f6-1df5f304f30a for instance b1d33b43-1430-4d89-a575-731a73a3f50a on hv-cinder-84456 Oct 04 09:06:47.059010 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-b000098f-201a-4fa5-af8e-cc0b5e89a67d req-80911921-1079-4ff8-9d94-46183a21aaae service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031200 Oct 04 09:06:47.059566 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 638/1229] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:06:47.418313 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-63031a51-717d-447c-b0f9-7a6a716f6b7f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:47.419330 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-63031a51-717d-447c-b0f9-7a6a716f6b7f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:47.427521 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63031a51-717d-447c-b0f9-7a6a716f6b7f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:47.428043 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63031a51-717d-447c-b0f9-7a6a716f6b7f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:47.428484 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63031a51-717d-447c-b0f9-7a6a716f6b7f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:47.429184 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63031a51-717d-447c-b0f9-7a6a716f6b7f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:47.429638 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63031a51-717d-447c-b0f9-7a6a716f6b7f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:47.430064 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-63031a51-717d-447c-b0f9-7a6a716f6b7f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:47.557239 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-63031a51-717d-447c-b0f9-7a6a716f6b7f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:47.565080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-63031a51-717d-447c-b0f9-7a6a716f6b7f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 200 len: 1367 microversion: 2.1 time: 0.152833 Oct 04 09:06:47.565630 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 592/1230] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:47 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:48.586491 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:48.587252 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=6 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:48.591926 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-66df7957-3ccc-4bf1-b454-a68cc74c4bd7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:48.592651 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-66df7957-3ccc-4bf1-b454-a68cc74c4bd7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:48.599854 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-66df7957-3ccc-4bf1-b454-a68cc74c4bd7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:48.600383 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-66df7957-3ccc-4bf1-b454-a68cc74c4bd7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:48.600850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-66df7957-3ccc-4bf1-b454-a68cc74c4bd7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:48.601523 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-66df7957-3ccc-4bf1-b454-a68cc74c4bd7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:48.601974 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-66df7957-3ccc-4bf1-b454-a68cc74c4bd7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:48.602379 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-66df7957-3ccc-4bf1-b454-a68cc74c4bd7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:48.736463 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-66df7957-3ccc-4bf1-b454-a68cc74c4bd7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:48.745373 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-66df7957-3ccc-4bf1-b454-a68cc74c4bd7 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 200 len: 1367 microversion: 2.1 time: 0.159889 Oct 04 09:06:48.745949 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 639/1231] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:48 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:49.771112 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-c316d0b8-e928-4a16-8065-3ed6a4655690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:49.771864 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-c316d0b8-e928-4a16-8065-3ed6a4655690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:49.774128 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=6 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:49.780440 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c316d0b8-e928-4a16-8065-3ed6a4655690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:49.780968 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c316d0b8-e928-4a16-8065-3ed6a4655690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:49.781481 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c316d0b8-e928-4a16-8065-3ed6a4655690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:49.782235 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c316d0b8-e928-4a16-8065-3ed6a4655690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:49.782807 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c316d0b8-e928-4a16-8065-3ed6a4655690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:49.783282 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-c316d0b8-e928-4a16-8065-3ed6a4655690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:49.916399 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-c316d0b8-e928-4a16-8065-3ed6a4655690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:49.924202 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-c316d0b8-e928-4a16-8065-3ed6a4655690 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 200 len: 1557 microversion: 2.1 time: 0.157991 Oct 04 09:06:49.924782 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 593/1232] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:49 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:49.946463 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-143968b9-1e2f-4ea9-9691-a776a07235e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:49.947021 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-143968b9-1e2f-4ea9-9691-a776a07235e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:49.953638 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-143968b9-1e2f-4ea9-9691-a776a07235e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:49.954118 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-143968b9-1e2f-4ea9-9691-a776a07235e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:49.954616 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-143968b9-1e2f-4ea9-9691-a776a07235e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:49.955306 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-143968b9-1e2f-4ea9-9691-a776a07235e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:49.955752 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-143968b9-1e2f-4ea9-9691-a776a07235e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:49.956197 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-143968b9-1e2f-4ea9-9691-a776a07235e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:50.039205 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-143968b9-1e2f-4ea9-9691-a776a07235e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096301 Oct 04 09:06:50.040157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 640/1233] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Oct 4 09:06:49 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:06:51.066616 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-b2e92ca3-3549-439e-b9d5-53e125380c9d req-68231a38-4e27-4a4f-973e-453ad25247db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d33b43-1430-4d89-a575-731a73a3f50a", "tag": "eb5e072f-d634-42c3-b6f6-1df5f304f30a"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:06:51.076082 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-b2e92ca3-3549-439e-b9d5-53e125380c9d req-68231a38-4e27-4a4f-973e-453ad25247db service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:51.076558 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-b2e92ca3-3549-439e-b9d5-53e125380c9d req-68231a38-4e27-4a4f-973e-453ad25247db service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:51.076981 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-b2e92ca3-3549-439e-b9d5-53e125380c9d req-68231a38-4e27-4a4f-973e-453ad25247db service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:51.087912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-b2e92ca3-3549-439e-b9d5-53e125380c9d req-68231a38-4e27-4a4f-973e-453ad25247db service nova] Creating event network-changed:eb5e072f-d634-42c3-b6f6-1df5f304f30a for instance b1d33b43-1430-4d89-a575-731a73a3f50a on hv-cinder-84456 Oct 04 09:06:51.093010 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-b2e92ca3-3549-439e-b9d5-53e125380c9d req-68231a38-4e27-4a4f-973e-453ad25247db service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093521 Oct 04 09:06:51.093605 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 594/1234] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:07:07.894199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:07.894955 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:07.899109 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a944189f-8b73-43fc-b618-6e527893748b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:07:07.899645 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a944189f-8b73-43fc-b618-6e527893748b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:07.907228 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a944189f-8b73-43fc-b618-6e527893748b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:07.907698 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a944189f-8b73-43fc-b618-6e527893748b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:07.908215 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a944189f-8b73-43fc-b618-6e527893748b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:07.908978 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a944189f-8b73-43fc-b618-6e527893748b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:07.909405 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a944189f-8b73-43fc-b618-6e527893748b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:07.909855 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a944189f-8b73-43fc-b618-6e527893748b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:07.933316 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-a944189f-8b73-43fc-b618-6e527893748b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lazy-loading 'flavor' on Instance uuid 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:07:08.010883 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a944189f-8b73-43fc-b618-6e527893748b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "POST /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8/action" status: 202 len: 0 microversion: 2.1 time: 0.118758 Oct 04 09:07:08.011477 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 641/1235] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Oct 4 09:07:07 2022] POST /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:07:08.018978 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:08.019721 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:08.024443 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f1d8cd92-4fa8-4cc3-ad20-b8b797005e62 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:08.025313 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f1d8cd92-4fa8-4cc3-ad20-b8b797005e62 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:08.034640 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f1d8cd92-4fa8-4cc3-ad20-b8b797005e62 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:08.035740 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f1d8cd92-4fa8-4cc3-ad20-b8b797005e62 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:08.036270 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f1d8cd92-4fa8-4cc3-ad20-b8b797005e62 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:08.037036 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f1d8cd92-4fa8-4cc3-ad20-b8b797005e62 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:08.037483 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f1d8cd92-4fa8-4cc3-ad20-b8b797005e62 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:08.037903 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f1d8cd92-4fa8-4cc3-ad20-b8b797005e62 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:08.189327 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f1d8cd92-4fa8-4cc3-ad20-b8b797005e62 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:08.197484 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f1d8cd92-4fa8-4cc3-ad20-b8b797005e62 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.181307 Oct 04 09:07:08.198269 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 595/1236] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:08 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:07:09.232038 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f41b42e9-ffcb-4459-9a60-026fad2e9a65 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:09.233099 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f41b42e9-ffcb-4459-9a60-026fad2e9a65 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:09.241586 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f41b42e9-ffcb-4459-9a60-026fad2e9a65 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:09.242064 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f41b42e9-ffcb-4459-9a60-026fad2e9a65 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:09.242495 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f41b42e9-ffcb-4459-9a60-026fad2e9a65 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:09.243178 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f41b42e9-ffcb-4459-9a60-026fad2e9a65 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:09.243623 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f41b42e9-ffcb-4459-9a60-026fad2e9a65 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:09.244076 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f41b42e9-ffcb-4459-9a60-026fad2e9a65 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:09.376784 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f41b42e9-ffcb-4459-9a60-026fad2e9a65 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:09.388954 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f41b42e9-ffcb-4459-9a60-026fad2e9a65 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.164615 Oct 04 09:07:09.389801 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 642/1237] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:09 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:10.414470 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-85c42538-eba2-4c2f-b24e-0cf42e4a3672 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:10.415175 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-85c42538-eba2-4c2f-b24e-0cf42e4a3672 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:10.423178 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85c42538-eba2-4c2f-b24e-0cf42e4a3672 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:10.423741 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85c42538-eba2-4c2f-b24e-0cf42e4a3672 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:10.424285 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85c42538-eba2-4c2f-b24e-0cf42e4a3672 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:10.425096 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85c42538-eba2-4c2f-b24e-0cf42e4a3672 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:10.425625 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85c42538-eba2-4c2f-b24e-0cf42e4a3672 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:10.426246 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-85c42538-eba2-4c2f-b24e-0cf42e4a3672 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:10.557614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-85c42538-eba2-4c2f-b24e-0cf42e4a3672 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:10.568594 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-85c42538-eba2-4c2f-b24e-0cf42e4a3672 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.159135 Oct 04 09:07:10.569169 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 596/1238] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:10 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:11.595489 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-7567f2ea-c798-451b-aed1-f497706b92a5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:11.596527 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-7567f2ea-c798-451b-aed1-f497706b92a5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:11.604195 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7567f2ea-c798-451b-aed1-f497706b92a5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:11.604679 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7567f2ea-c798-451b-aed1-f497706b92a5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:11.605092 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7567f2ea-c798-451b-aed1-f497706b92a5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:11.605815 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7567f2ea-c798-451b-aed1-f497706b92a5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:11.606273 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7567f2ea-c798-451b-aed1-f497706b92a5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:11.606695 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-7567f2ea-c798-451b-aed1-f497706b92a5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:11.750419 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-7567f2ea-c798-451b-aed1-f497706b92a5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:11.762476 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-7567f2ea-c798-451b-aed1-f497706b92a5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.173175 Oct 04 09:07:11.763027 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 643/1239] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:11 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:12.787534 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fad501ff-5be6-4f18-9f46-d910cc76b510 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:12.788189 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-fad501ff-5be6-4f18-9f46-d910cc76b510 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:12.795093 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fad501ff-5be6-4f18-9f46-d910cc76b510 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:12.795582 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fad501ff-5be6-4f18-9f46-d910cc76b510 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:12.796057 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fad501ff-5be6-4f18-9f46-d910cc76b510 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:12.796758 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fad501ff-5be6-4f18-9f46-d910cc76b510 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:12.797214 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fad501ff-5be6-4f18-9f46-d910cc76b510 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:12.797644 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fad501ff-5be6-4f18-9f46-d910cc76b510 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:12.937912 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-fad501ff-5be6-4f18-9f46-d910cc76b510 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:12.948542 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fad501ff-5be6-4f18-9f46-d910cc76b510 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.166322 Oct 04 09:07:12.952320 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 597/1240] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:12 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:13.974337 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-31b00ef6-a109-418f-9676-37ca36d6d343 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:13.974899 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-31b00ef6-a109-418f-9676-37ca36d6d343 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:13.983936 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-31b00ef6-a109-418f-9676-37ca36d6d343 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:13.984652 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-31b00ef6-a109-418f-9676-37ca36d6d343 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:13.985224 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-31b00ef6-a109-418f-9676-37ca36d6d343 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:13.986143 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-31b00ef6-a109-418f-9676-37ca36d6d343 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:13.986741 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-31b00ef6-a109-418f-9676-37ca36d6d343 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:13.987298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-31b00ef6-a109-418f-9676-37ca36d6d343 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:14.122296 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-31b00ef6-a109-418f-9676-37ca36d6d343 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:14.134027 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-31b00ef6-a109-418f-9676-37ca36d6d343 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.165121 Oct 04 09:07:14.134759 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 644/1241] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:13 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:15.165441 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-99dbbea5-574f-4385-af73-bdb1cbe3863b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:15.166454 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-99dbbea5-574f-4385-af73-bdb1cbe3863b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:15.177424 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-99dbbea5-574f-4385-af73-bdb1cbe3863b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:15.178234 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-99dbbea5-574f-4385-af73-bdb1cbe3863b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:15.178959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-99dbbea5-574f-4385-af73-bdb1cbe3863b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:15.180144 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-99dbbea5-574f-4385-af73-bdb1cbe3863b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:15.180956 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-99dbbea5-574f-4385-af73-bdb1cbe3863b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:15.181705 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-99dbbea5-574f-4385-af73-bdb1cbe3863b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:15.321425 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-99dbbea5-574f-4385-af73-bdb1cbe3863b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:15.331614 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-99dbbea5-574f-4385-af73-bdb1cbe3863b tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.173370 Oct 04 09:07:15.332231 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 598/1242] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:15 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:16.355200 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-88488546-005f-46ef-8b37-3c660e7c91ab tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:16.355828 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-88488546-005f-46ef-8b37-3c660e7c91ab tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:16.362698 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-88488546-005f-46ef-8b37-3c660e7c91ab tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:16.363176 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-88488546-005f-46ef-8b37-3c660e7c91ab tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:16.363602 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-88488546-005f-46ef-8b37-3c660e7c91ab tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:16.364337 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-88488546-005f-46ef-8b37-3c660e7c91ab tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:16.365181 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-88488546-005f-46ef-8b37-3c660e7c91ab tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:16.365596 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-88488546-005f-46ef-8b37-3c660e7c91ab tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:16.507359 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-88488546-005f-46ef-8b37-3c660e7c91ab tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:16.515850 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-88488546-005f-46ef-8b37-3c660e7c91ab tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.164587 Oct 04 09:07:16.516464 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 645/1243] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:16 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:17.539801 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b396a88b-8d13-4c7e-be2a-aa1e9e7d047e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:17.540453 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b396a88b-8d13-4c7e-be2a-aa1e9e7d047e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:17.547402 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b396a88b-8d13-4c7e-be2a-aa1e9e7d047e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:17.547917 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b396a88b-8d13-4c7e-be2a-aa1e9e7d047e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:17.548357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b396a88b-8d13-4c7e-be2a-aa1e9e7d047e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:17.549064 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b396a88b-8d13-4c7e-be2a-aa1e9e7d047e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:17.549523 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b396a88b-8d13-4c7e-be2a-aa1e9e7d047e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:17.549954 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b396a88b-8d13-4c7e-be2a-aa1e9e7d047e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:17.694084 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b396a88b-8d13-4c7e-be2a-aa1e9e7d047e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:17.702414 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b396a88b-8d13-4c7e-be2a-aa1e9e7d047e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.166764 Oct 04 09:07:17.702985 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 599/1244] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:17 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:18.729967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e4d34df5-dccf-4c60-a47a-0bbe18b2ec07 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:18.731065 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e4d34df5-dccf-4c60-a47a-0bbe18b2ec07 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:18.741704 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4d34df5-dccf-4c60-a47a-0bbe18b2ec07 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:18.742155 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4d34df5-dccf-4c60-a47a-0bbe18b2ec07 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:18.742614 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4d34df5-dccf-4c60-a47a-0bbe18b2ec07 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:18.743282 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4d34df5-dccf-4c60-a47a-0bbe18b2ec07 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:18.743761 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4d34df5-dccf-4c60-a47a-0bbe18b2ec07 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:18.744212 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e4d34df5-dccf-4c60-a47a-0bbe18b2ec07 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:18.875160 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e4d34df5-dccf-4c60-a47a-0bbe18b2ec07 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:18.883060 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e4d34df5-dccf-4c60-a47a-0bbe18b2ec07 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.159871 Oct 04 09:07:18.883635 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 646/1245] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:18 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:19.911228 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-eabdd7f4-6e22-4572-a08a-d9c759d3e093 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:19.912379 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-eabdd7f4-6e22-4572-a08a-d9c759d3e093 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:19.922589 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-eabdd7f4-6e22-4572-a08a-d9c759d3e093 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:19.923406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-eabdd7f4-6e22-4572-a08a-d9c759d3e093 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:19.924200 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-eabdd7f4-6e22-4572-a08a-d9c759d3e093 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:19.925340 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-eabdd7f4-6e22-4572-a08a-d9c759d3e093 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:19.926094 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-eabdd7f4-6e22-4572-a08a-d9c759d3e093 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:19.926807 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-eabdd7f4-6e22-4572-a08a-d9c759d3e093 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:20.073432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-eabdd7f4-6e22-4572-a08a-d9c759d3e093 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:20.081383 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-eabdd7f4-6e22-4572-a08a-d9c759d3e093 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.176998 Oct 04 09:07:20.081965 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 600/1246] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:19 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:21.108889 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-17dd16b2-205e-4d5a-9de5-696e8b8b9c58 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:21.109860 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-17dd16b2-205e-4d5a-9de5-696e8b8b9c58 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:21.122183 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17dd16b2-205e-4d5a-9de5-696e8b8b9c58 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:21.122988 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17dd16b2-205e-4d5a-9de5-696e8b8b9c58 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:21.123751 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17dd16b2-205e-4d5a-9de5-696e8b8b9c58 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:21.124904 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17dd16b2-205e-4d5a-9de5-696e8b8b9c58 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:21.125656 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17dd16b2-205e-4d5a-9de5-696e8b8b9c58 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:21.126330 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-17dd16b2-205e-4d5a-9de5-696e8b8b9c58 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:21.257410 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-17dd16b2-205e-4d5a-9de5-696e8b8b9c58 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:21.265570 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-17dd16b2-205e-4d5a-9de5-696e8b8b9c58 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.163273 Oct 04 09:07:21.266150 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 647/1247] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:21 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:22.292561 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-beed1592-49f7-4e6d-9034-42811546d8b2 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:22.293551 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-beed1592-49f7-4e6d-9034-42811546d8b2 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:22.303720 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-beed1592-49f7-4e6d-9034-42811546d8b2 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:22.304239 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-beed1592-49f7-4e6d-9034-42811546d8b2 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:22.304676 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-beed1592-49f7-4e6d-9034-42811546d8b2 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:22.305363 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-beed1592-49f7-4e6d-9034-42811546d8b2 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:22.305817 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-beed1592-49f7-4e6d-9034-42811546d8b2 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:22.306239 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-beed1592-49f7-4e6d-9034-42811546d8b2 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:22.463005 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-beed1592-49f7-4e6d-9034-42811546d8b2 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:22.474947 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-beed1592-49f7-4e6d-9034-42811546d8b2 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.188815 Oct 04 09:07:22.475740 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 601/1248] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:22 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:23.499268 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e41132cd-1863-4689-9d4f-85efc3ebd191 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:23.499877 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e41132cd-1863-4689-9d4f-85efc3ebd191 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:23.506834 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e41132cd-1863-4689-9d4f-85efc3ebd191 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:23.507314 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e41132cd-1863-4689-9d4f-85efc3ebd191 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:23.507861 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e41132cd-1863-4689-9d4f-85efc3ebd191 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:23.508618 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e41132cd-1863-4689-9d4f-85efc3ebd191 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:23.509068 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e41132cd-1863-4689-9d4f-85efc3ebd191 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:23.509525 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e41132cd-1863-4689-9d4f-85efc3ebd191 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:23.641904 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e41132cd-1863-4689-9d4f-85efc3ebd191 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:23.650236 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e41132cd-1863-4689-9d4f-85efc3ebd191 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.155333 Oct 04 09:07:23.650847 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 648/1249] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:23 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:24.677713 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-27cad337-d994-4ece-9cee-09c84bc94a6c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:24.678472 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-27cad337-d994-4ece-9cee-09c84bc94a6c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:24.687000 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-27cad337-d994-4ece-9cee-09c84bc94a6c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:24.687602 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-27cad337-d994-4ece-9cee-09c84bc94a6c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:24.688197 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-27cad337-d994-4ece-9cee-09c84bc94a6c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:24.689055 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-27cad337-d994-4ece-9cee-09c84bc94a6c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:24.689618 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-27cad337-d994-4ece-9cee-09c84bc94a6c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:24.690149 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-27cad337-d994-4ece-9cee-09c84bc94a6c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:24.832884 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-27cad337-d994-4ece-9cee-09c84bc94a6c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:24.844907 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-27cad337-d994-4ece-9cee-09c84bc94a6c tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.173516 Oct 04 09:07:24.845467 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 602/1250] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:24 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:25.871579 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1147445c-a208-422c-822e-964782a50816 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:25.872180 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1147445c-a208-422c-822e-964782a50816 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:25.878915 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1147445c-a208-422c-822e-964782a50816 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:25.879395 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1147445c-a208-422c-822e-964782a50816 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:25.879806 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1147445c-a208-422c-822e-964782a50816 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:25.880542 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1147445c-a208-422c-822e-964782a50816 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:25.880987 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1147445c-a208-422c-822e-964782a50816 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:25.881401 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1147445c-a208-422c-822e-964782a50816 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:26.022640 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-1147445c-a208-422c-822e-964782a50816 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:26.031416 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1147445c-a208-422c-822e-964782a50816 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.163914 Oct 04 09:07:26.032004 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 649/1251] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:25 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:27.065270 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-f3dcbf81-9a39-4806-b33b-1cac93a84b6a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:27.066267 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-f3dcbf81-9a39-4806-b33b-1cac93a84b6a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:27.074545 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f3dcbf81-9a39-4806-b33b-1cac93a84b6a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:27.075027 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f3dcbf81-9a39-4806-b33b-1cac93a84b6a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:27.075460 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f3dcbf81-9a39-4806-b33b-1cac93a84b6a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:27.076220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f3dcbf81-9a39-4806-b33b-1cac93a84b6a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:27.076670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f3dcbf81-9a39-4806-b33b-1cac93a84b6a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:27.077094 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-f3dcbf81-9a39-4806-b33b-1cac93a84b6a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:27.208191 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-f3dcbf81-9a39-4806-b33b-1cac93a84b6a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:27.220275 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-f3dcbf81-9a39-4806-b33b-1cac93a84b6a tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1511 microversion: 2.1 time: 0.161334 Oct 04 09:07:27.221072 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 603/1252] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:27 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:27.246502 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-65e24b53-4543-4713-b0c9-e87888f691c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:07:27.247114 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-65e24b53-4543-4713-b0c9-e87888f691c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:27.253231 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65e24b53-4543-4713-b0c9-e87888f691c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:27.253709 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65e24b53-4543-4713-b0c9-e87888f691c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:27.254141 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65e24b53-4543-4713-b0c9-e87888f691c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:27.254827 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65e24b53-4543-4713-b0c9-e87888f691c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:27.255277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65e24b53-4543-4713-b0c9-e87888f691c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:27.255693 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-65e24b53-4543-4713-b0c9-e87888f691c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:27.298614 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-65e24b53-4543-4713-b0c9-e87888f691c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=142438) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 09:07:27.375636 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-65e24b53-4543-4713-b0c9-e87888f691c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "POST /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8/action" status: 202 len: 0 microversion: 2.1 time: 0.133340 Oct 04 09:07:27.376277 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 650/1253] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Oct 4 09:07:27 2022] POST /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:07:27.384712 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2bc9e51c-1a9e-4234-9ae5-74a3cd52a4c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:27.385321 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2bc9e51c-1a9e-4234-9ae5-74a3cd52a4c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:27.391524 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2bc9e51c-1a9e-4234-9ae5-74a3cd52a4c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:27.392043 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2bc9e51c-1a9e-4234-9ae5-74a3cd52a4c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:27.392474 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2bc9e51c-1a9e-4234-9ae5-74a3cd52a4c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:27.393162 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2bc9e51c-1a9e-4234-9ae5-74a3cd52a4c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:27.393608 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2bc9e51c-1a9e-4234-9ae5-74a3cd52a4c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:27.394227 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2bc9e51c-1a9e-4234-9ae5-74a3cd52a4c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:27.560459 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2bc9e51c-1a9e-4234-9ae5-74a3cd52a4c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:27.568706 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2bc9e51c-1a9e-4234-9ae5-74a3cd52a4c3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1519 microversion: 2.1 time: 0.188137 Oct 04 09:07:27.569273 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 604/1254] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:27 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:28.601395 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-e8264cbb-a878-4392-8256-f70144893820 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:28.601999 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-e8264cbb-a878-4392-8256-f70144893820 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:28.612743 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e8264cbb-a878-4392-8256-f70144893820 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:28.613286 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e8264cbb-a878-4392-8256-f70144893820 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:28.613748 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e8264cbb-a878-4392-8256-f70144893820 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:28.614786 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e8264cbb-a878-4392-8256-f70144893820 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:28.615248 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e8264cbb-a878-4392-8256-f70144893820 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:28.615672 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-e8264cbb-a878-4392-8256-f70144893820 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:28.772444 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-e8264cbb-a878-4392-8256-f70144893820 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:28.781001 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-e8264cbb-a878-4392-8256-f70144893820 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1521 microversion: 2.1 time: 0.191927 Oct 04 09:07:28.781697 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 651/1255] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:28 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:29.258650 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-64f6a4f5-a214-443e-ba22-19341cc4f973 req-6724da44-a17a-4482-bb42-c766cd9f0c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a22dc3-e2b5-48af-a968-ca6ecdfc50e8", "name": "network-vif-unplugged", "status": "completed", "tag": "8d2a9d8b-a2ca-4a6d-b218-6582fd84af52"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:07:29.270632 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-64f6a4f5-a214-443e-ba22-19341cc4f973 req-6724da44-a17a-4482-bb42-c766cd9f0c4b service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:29.271146 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-64f6a4f5-a214-443e-ba22-19341cc4f973 req-6724da44-a17a-4482-bb42-c766cd9f0c4b service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:29.271666 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-64f6a4f5-a214-443e-ba22-19341cc4f973 req-6724da44-a17a-4482-bb42-c766cd9f0c4b service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:29.284635 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-64f6a4f5-a214-443e-ba22-19341cc4f973 req-6724da44-a17a-4482-bb42-c766cd9f0c4b service nova] Creating event network-vif-unplugged:8d2a9d8b-a2ca-4a6d-b218-6582fd84af52 for instance 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 on hv-cinder-84456 Oct 04 09:07:29.290938 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-64f6a4f5-a214-443e-ba22-19341cc4f973 req-6724da44-a17a-4482-bb42-c766cd9f0c4b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036010 Oct 04 09:07:29.291735 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 605/1256] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:07:29.804781 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-c7f7b663-499b-4769-8e76-2746bf804ead tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:29.805419 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-c7f7b663-499b-4769-8e76-2746bf804ead tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:29.812217 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c7f7b663-499b-4769-8e76-2746bf804ead tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:29.812704 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c7f7b663-499b-4769-8e76-2746bf804ead tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:29.813140 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c7f7b663-499b-4769-8e76-2746bf804ead tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:29.813839 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c7f7b663-499b-4769-8e76-2746bf804ead tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:29.814288 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c7f7b663-499b-4769-8e76-2746bf804ead tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:29.814760 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-c7f7b663-499b-4769-8e76-2746bf804ead tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:29.955653 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-c7f7b663-499b-4769-8e76-2746bf804ead tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:29.964624 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-c7f7b663-499b-4769-8e76-2746bf804ead tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1577 microversion: 2.1 time: 0.163773 Oct 04 09:07:29.965232 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 652/1257] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:29 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:30.990574 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-4118c020-9049-4589-86ab-639f61d2a942 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:30.991446 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-4118c020-9049-4589-86ab-639f61d2a942 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:31.001282 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4118c020-9049-4589-86ab-639f61d2a942 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:31.001756 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4118c020-9049-4589-86ab-639f61d2a942 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:31.002194 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4118c020-9049-4589-86ab-639f61d2a942 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:31.002909 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4118c020-9049-4589-86ab-639f61d2a942 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:31.003359 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4118c020-9049-4589-86ab-639f61d2a942 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:31.003783 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-4118c020-9049-4589-86ab-639f61d2a942 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:31.143570 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-4118c020-9049-4589-86ab-639f61d2a942 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:31.156461 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-4118c020-9049-4589-86ab-639f61d2a942 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1577 microversion: 2.1 time: 0.171179 Oct 04 09:07:31.157355 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 606/1258] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:30 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:32.187204 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d058add2-8982-4581-a234-d073e423061d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:32.188312 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-d058add2-8982-4581-a234-d073e423061d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:32.198332 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d058add2-8982-4581-a234-d073e423061d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:32.198821 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d058add2-8982-4581-a234-d073e423061d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:32.199258 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d058add2-8982-4581-a234-d073e423061d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:32.199988 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d058add2-8982-4581-a234-d073e423061d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:32.200441 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d058add2-8982-4581-a234-d073e423061d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:32.200865 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-d058add2-8982-4581-a234-d073e423061d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:32.338018 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-d058add2-8982-4581-a234-d073e423061d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:32.345897 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d058add2-8982-4581-a234-d073e423061d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1577 microversion: 2.1 time: 0.165230 Oct 04 09:07:32.346479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 653/1259] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:32 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:33.373642 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fec010a6-7b7e-4cd5-bf80-5ce25755817d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:33.374628 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-fec010a6-7b7e-4cd5-bf80-5ce25755817d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:33.385097 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fec010a6-7b7e-4cd5-bf80-5ce25755817d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:33.385580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fec010a6-7b7e-4cd5-bf80-5ce25755817d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:33.386011 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fec010a6-7b7e-4cd5-bf80-5ce25755817d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:33.386698 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fec010a6-7b7e-4cd5-bf80-5ce25755817d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:33.387149 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fec010a6-7b7e-4cd5-bf80-5ce25755817d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:33.387571 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fec010a6-7b7e-4cd5-bf80-5ce25755817d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:33.526384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-fec010a6-7b7e-4cd5-bf80-5ce25755817d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:33.534622 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fec010a6-7b7e-4cd5-bf80-5ce25755817d tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1577 microversion: 2.1 time: 0.167599 Oct 04 09:07:33.535173 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 607/1260] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:33 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:34.562319 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-41c75728-aa78-4a5a-9e8a-fd6d1c03ddd7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:34.563320 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-41c75728-aa78-4a5a-9e8a-fd6d1c03ddd7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:34.574009 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41c75728-aa78-4a5a-9e8a-fd6d1c03ddd7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:34.574795 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41c75728-aa78-4a5a-9e8a-fd6d1c03ddd7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:34.575506 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41c75728-aa78-4a5a-9e8a-fd6d1c03ddd7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:34.576674 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41c75728-aa78-4a5a-9e8a-fd6d1c03ddd7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:34.577408 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41c75728-aa78-4a5a-9e8a-fd6d1c03ddd7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:34.578093 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-41c75728-aa78-4a5a-9e8a-fd6d1c03ddd7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:34.599933 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:34.720565 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-41c75728-aa78-4a5a-9e8a-fd6d1c03ddd7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:34.728702 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-41c75728-aa78-4a5a-9e8a-fd6d1c03ddd7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1577 microversion: 2.1 time: 0.173447 Oct 04 09:07:34.729279 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 654/1261] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:34 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:35.756468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-5a44b7f2-7662-42e6-b22b-65c4e3fa4b21 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:35.757530 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-5a44b7f2-7662-42e6-b22b-65c4e3fa4b21 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:35.765406 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5a44b7f2-7662-42e6-b22b-65c4e3fa4b21 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:35.765932 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5a44b7f2-7662-42e6-b22b-65c4e3fa4b21 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:35.766353 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5a44b7f2-7662-42e6-b22b-65c4e3fa4b21 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:35.767171 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5a44b7f2-7662-42e6-b22b-65c4e3fa4b21 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:35.767637 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5a44b7f2-7662-42e6-b22b-65c4e3fa4b21 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:35.768160 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-5a44b7f2-7662-42e6-b22b-65c4e3fa4b21 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:35.898932 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-5a44b7f2-7662-42e6-b22b-65c4e3fa4b21 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:35.907129 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-5a44b7f2-7662-42e6-b22b-65c4e3fa4b21 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1577 microversion: 2.1 time: 0.157457 Oct 04 09:07:35.907703 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 608/1262] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:35 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:36.937532 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0c3dccde-46d8-4327-9576-0873cfaa0aa9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:36.938507 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0c3dccde-46d8-4327-9576-0873cfaa0aa9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:36.949654 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0c3dccde-46d8-4327-9576-0873cfaa0aa9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:36.950412 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0c3dccde-46d8-4327-9576-0873cfaa0aa9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:36.951188 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0c3dccde-46d8-4327-9576-0873cfaa0aa9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:36.952344 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0c3dccde-46d8-4327-9576-0873cfaa0aa9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:36.953094 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0c3dccde-46d8-4327-9576-0873cfaa0aa9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:36.953796 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0c3dccde-46d8-4327-9576-0873cfaa0aa9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:37.092411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0c3dccde-46d8-4327-9576-0873cfaa0aa9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:37.103991 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0c3dccde-46d8-4327-9576-0873cfaa0aa9 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1577 microversion: 2.1 time: 0.173370 Oct 04 09:07:37.104568 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 655/1263] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:36 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:38.128509 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ab01b829-5cee-444d-8b1a-9aec40bfe8e3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:38.129095 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-ab01b829-5cee-444d-8b1a-9aec40bfe8e3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:38.131585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=29 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:38.137378 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ab01b829-5cee-444d-8b1a-9aec40bfe8e3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:38.137861 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ab01b829-5cee-444d-8b1a-9aec40bfe8e3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:38.138291 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ab01b829-5cee-444d-8b1a-9aec40bfe8e3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:38.138983 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ab01b829-5cee-444d-8b1a-9aec40bfe8e3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:38.139427 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ab01b829-5cee-444d-8b1a-9aec40bfe8e3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:38.139865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-ab01b829-5cee-444d-8b1a-9aec40bfe8e3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:38.142564 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=81 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:38.290874 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-ab01b829-5cee-444d-8b1a-9aec40bfe8e3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:38.302489 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ab01b829-5cee-444d-8b1a-9aec40bfe8e3 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1577 microversion: 2.1 time: 0.177779 Oct 04 09:07:38.303241 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 609/1264] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:38 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:39.327066 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-0e5a2f65-34d3-4226-9e41-ba1ccbdb1548 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:39.327701 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-0e5a2f65-34d3-4226-9e41-ba1ccbdb1548 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:39.330232 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:39.335616 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0e5a2f65-34d3-4226-9e41-ba1ccbdb1548 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:39.336160 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0e5a2f65-34d3-4226-9e41-ba1ccbdb1548 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:39.336591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0e5a2f65-34d3-4226-9e41-ba1ccbdb1548 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:39.337460 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0e5a2f65-34d3-4226-9e41-ba1ccbdb1548 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:39.337907 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0e5a2f65-34d3-4226-9e41-ba1ccbdb1548 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:39.338348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-0e5a2f65-34d3-4226-9e41-ba1ccbdb1548 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:39.475711 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-0e5a2f65-34d3-4226-9e41-ba1ccbdb1548 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:39.484574 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-0e5a2f65-34d3-4226-9e41-ba1ccbdb1548 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1577 microversion: 2.1 time: 0.161503 Oct 04 09:07:39.485199 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 656/1265] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:39 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:40.508570 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-04d4b027-242b-46f8-a132-6ec2acd9e571 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:40.509147 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-04d4b027-242b-46f8-a132-6ec2acd9e571 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:40.515636 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-04d4b027-242b-46f8-a132-6ec2acd9e571 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:40.516158 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-04d4b027-242b-46f8-a132-6ec2acd9e571 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:40.516868 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-04d4b027-242b-46f8-a132-6ec2acd9e571 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:40.517549 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-04d4b027-242b-46f8-a132-6ec2acd9e571 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:40.517996 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-04d4b027-242b-46f8-a132-6ec2acd9e571 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:40.518417 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-04d4b027-242b-46f8-a132-6ec2acd9e571 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:40.661434 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-04d4b027-242b-46f8-a132-6ec2acd9e571 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:40.673013 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-04d4b027-242b-46f8-a132-6ec2acd9e571 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1577 microversion: 2.1 time: 0.168091 Oct 04 09:07:40.673789 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 610/1266] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:40 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:41.363587 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-213f8356-6854-4375-b45f-20c85d0a1fe5 req-fc579e88-c6e2-49cd-8918-9c55d444f3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a22dc3-e2b5-48af-a968-ca6ecdfc50e8", "name": "network-vif-plugged", "status": "completed", "tag": "8d2a9d8b-a2ca-4a6d-b218-6582fd84af52"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:07:41.374526 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-213f8356-6854-4375-b45f-20c85d0a1fe5 req-fc579e88-c6e2-49cd-8918-9c55d444f3eb service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:41.375214 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-213f8356-6854-4375-b45f-20c85d0a1fe5 req-fc579e88-c6e2-49cd-8918-9c55d444f3eb service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:41.375799 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-213f8356-6854-4375-b45f-20c85d0a1fe5 req-fc579e88-c6e2-49cd-8918-9c55d444f3eb service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:41.387455 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-213f8356-6854-4375-b45f-20c85d0a1fe5 req-fc579e88-c6e2-49cd-8918-9c55d444f3eb service nova] Creating event network-vif-plugged:8d2a9d8b-a2ca-4a6d-b218-6582fd84af52 for instance 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 on hv-cinder-84456 Oct 04 09:07:41.392584 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-213f8356-6854-4375-b45f-20c85d0a1fe5 req-fc579e88-c6e2-49cd-8918-9c55d444f3eb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032722 Oct 04 09:07:41.393185 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 657/1267] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:07:41.699209 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b5e4a4a0-e485-47a3-a667-c164711cc98e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:41.699790 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b5e4a4a0-e485-47a3-a667-c164711cc98e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:41.706716 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5e4a4a0-e485-47a3-a667-c164711cc98e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:41.707208 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5e4a4a0-e485-47a3-a667-c164711cc98e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:41.707646 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5e4a4a0-e485-47a3-a667-c164711cc98e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:41.708404 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5e4a4a0-e485-47a3-a667-c164711cc98e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:41.708860 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5e4a4a0-e485-47a3-a667-c164711cc98e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:41.709284 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b5e4a4a0-e485-47a3-a667-c164711cc98e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:41.840309 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b5e4a4a0-e485-47a3-a667-c164711cc98e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:41.848628 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b5e4a4a0-e485-47a3-a667-c164711cc98e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1577 microversion: 2.1 time: 0.153490 Oct 04 09:07:41.849203 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 611/1268] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:41 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:42.875659 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-ede36dbb-417b-4f28-acc1-5b3d4ee22c25 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:42.876488 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-ede36dbb-417b-4f28-acc1-5b3d4ee22c25 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:42.883829 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ede36dbb-417b-4f28-acc1-5b3d4ee22c25 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:42.884387 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ede36dbb-417b-4f28-acc1-5b3d4ee22c25 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:42.884855 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ede36dbb-417b-4f28-acc1-5b3d4ee22c25 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:42.885590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ede36dbb-417b-4f28-acc1-5b3d4ee22c25 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:42.886072 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ede36dbb-417b-4f28-acc1-5b3d4ee22c25 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:42.886514 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-ede36dbb-417b-4f28-acc1-5b3d4ee22c25 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:43.018654 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-ede36dbb-417b-4f28-acc1-5b3d4ee22c25 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:43.027080 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-ede36dbb-417b-4f28-acc1-5b3d4ee22c25 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1577 microversion: 2.1 time: 0.156567 Oct 04 09:07:43.027648 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 658/1269] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:42 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:44.050558 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-0ae6df09-4dee-4c10-a8c1-4e6e9712ffcc tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:44.051194 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-0ae6df09-4dee-4c10-a8c1-4e6e9712ffcc tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:44.058459 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0ae6df09-4dee-4c10-a8c1-4e6e9712ffcc tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:44.058936 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0ae6df09-4dee-4c10-a8c1-4e6e9712ffcc tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:44.059378 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0ae6df09-4dee-4c10-a8c1-4e6e9712ffcc tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:44.060093 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0ae6df09-4dee-4c10-a8c1-4e6e9712ffcc tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:44.060543 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0ae6df09-4dee-4c10-a8c1-4e6e9712ffcc tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:44.060964 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-0ae6df09-4dee-4c10-a8c1-4e6e9712ffcc tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:44.204791 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-0ae6df09-4dee-4c10-a8c1-4e6e9712ffcc tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:44.214295 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-0ae6df09-4dee-4c10-a8c1-4e6e9712ffcc tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1564 microversion: 2.1 time: 0.167642 Oct 04 09:07:44.214866 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 612/1270] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:44 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:55.520308 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-dc7c4897-e5e2-442d-883d-774f83153e24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:55.521301 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-dc7c4897-e5e2-442d-883d-774f83153e24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:55.525150 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=5 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:55.526229 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=22 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:55.534425 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc7c4897-e5e2-442d-883d-774f83153e24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:55.534908 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc7c4897-e5e2-442d-883d-774f83153e24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:55.535345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc7c4897-e5e2-442d-883d-774f83153e24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:55.536044 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc7c4897-e5e2-442d-883d-774f83153e24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:55.536496 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc7c4897-e5e2-442d-883d-774f83153e24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:55.536914 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc7c4897-e5e2-442d-883d-774f83153e24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:55.560256 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-dc7c4897-e5e2-442d-883d-774f83153e24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/ips" status: 200 len: 149 microversion: 2.1 time: 0.046713 Oct 04 09:07:55.560823 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 659/1271] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Oct 4 09:07:55 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:07:56.914109 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b05af272-6af2-4911-be69-556facad9292 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d52597fc-8818-42ec-9511-b49b8cca5a29"}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:07:56.917531 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b05af272-6af2-4911-be69-556facad9292 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:56.920455 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=7 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:56.921561 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=23 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:56.927450 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b05af272-6af2-4911-be69-556facad9292 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:56.927914 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b05af272-6af2-4911-be69-556facad9292 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:56.928386 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b05af272-6af2-4911-be69-556facad9292 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:56.929125 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b05af272-6af2-4911-be69-556facad9292 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:56.929573 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b05af272-6af2-4911-be69-556facad9292 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:56.930086 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b05af272-6af2-4911-be69-556facad9292 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:57.225503 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b05af272-6af2-4911-be69-556facad9292 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "POST /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318079 Oct 04 09:07:57.226109 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 613/1272] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Oct 4 09:07:56 2022] POST /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:08:04.845485 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b0ca4642-fd75-4e9e-a387-50d30f9b8016 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d52597fc-8818-42ec-9511-b49b8cca5a29"}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:08:04.849500 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b0ca4642-fd75-4e9e-a387-50d30f9b8016 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:04.857053 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b0ca4642-fd75-4e9e-a387-50d30f9b8016 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:04.857532 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b0ca4642-fd75-4e9e-a387-50d30f9b8016 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:04.860234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b0ca4642-fd75-4e9e-a387-50d30f9b8016 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:04.860234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b0ca4642-fd75-4e9e-a387-50d30f9b8016 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:04.860234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b0ca4642-fd75-4e9e-a387-50d30f9b8016 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:04.860234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b0ca4642-fd75-4e9e-a387-50d30f9b8016 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:04.967876 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-b0ca4642-fd75-4e9e-a387-50d30f9b8016 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] HTTP exception thrown: Invalid volume: volume d52597fc-8818-42ec-9511-b49b8cca5a29 is already attached to instances: b1d33b43-1430-4d89-a575-731a73a3f50a Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b0ca4642-fd75-4e9e-a387-50d30f9b8016 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Request method failure captured: Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: POST /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/os-volume_attachments HTTP/1.1 Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 74 Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_bNdsNoR1EJ0YryrP3LxGOA4CSKhOV3N2YTX5dRZGWbSMozvy9Uq2nzgH9fYhwhF5fUR2ahiSmulkP-Pv3i4rylMex1AwqCGffErBnDQcsWSLyokVVRtYTA5obgs2izUVEr7P4VXXwmn8LiZUH2LRl7KuHI9xyIQSl2BhPVU8SoXAk Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:08:04.969581 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:08:04.971479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89b56ee603d34a5f85f7e007b2fe668f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:08:04.971479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:08:04.971479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:08:04.971479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:08:04.971479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:08:04.971479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:08:04.971479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:08:04.971479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 3ec88da1704d44fb924fa3cc04e5fe25 Oct 04 09:08:04.971479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:08:04.971479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Oct 04 09:08:04.971479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {"volumeAttachment": {"volumeId": "d52597fc-8818-42ec-9511-b49b8cca5a29"}} Oct 04 09:08:04.971479 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Invalid volume: volume d52597fc-8818-42ec-9511-b49b8cca5a29 is already attached to instances: b1d33b43-1430-4d89-a575-731a73a3f50a Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'server_id': 'b1d33b43-1430-4d89-a575-731a73a3f50a', 'body': {'volumeAttachment': {'volumeId': 'd52597fc-8818-42ec-9511-b49b8cca5a29'}}} Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d52597fc-8818-42ec-9511-b49b8cca5a29 is already attached to instances: b1d33b43-1430-4d89-a575-731a73a3f50a Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:08:04.973247 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d52597fc-8818-42ec-9511-b49b8cca5a29 is already attached to instances: b1d33b43-1430-4d89-a575-731a73a3f50a Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:08:04.974992 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:08:04.976777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:08:04.976777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:08:04.976777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:08:04.976777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d52597fc-8818-42ec-9511-b49b8cca5a29 is already attached to instances: b1d33b43-1430-4d89-a575-731a73a3f50a Oct 04 09:08:04.976777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:08:04.976777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b0ca4642-fd75-4e9e-a387-50d30f9b8016 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Returning 400 to user: Invalid volume: volume d52597fc-8818-42ec-9511-b49b8cca5a29 is already attached to instances: b1d33b43-1430-4d89-a575-731a73a3f50a {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:08:04.976777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b0ca4642-fd75-4e9e-a387-50d30f9b8016 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "POST /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.131940 Oct 04 09:08:04.976777 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 660/1273] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Oct 4 09:08:04 2022] POST /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/os-volume_attachments => generated 174 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 09:08:05.036948 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 09:08:05.037424 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Tue Oct 4 09:08:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/os-volume_attachments/d52597fc-8818-42ec-9511-b49b8cca5a29 (ip 10.222.0.44) !!! Oct 04 09:08:05.041595 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-7fc4170b-4a0e-48f4-9762-3cbb9618cd6a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:05.042174 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-7fc4170b-4a0e-48f4-9762-3cbb9618cd6a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:05.049843 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7fc4170b-4a0e-48f4-9762-3cbb9618cd6a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:05.050321 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7fc4170b-4a0e-48f4-9762-3cbb9618cd6a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:05.050756 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7fc4170b-4a0e-48f4-9762-3cbb9618cd6a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:05.051444 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7fc4170b-4a0e-48f4-9762-3cbb9618cd6a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:05.051921 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7fc4170b-4a0e-48f4-9762-3cbb9618cd6a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:05.052365 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-7fc4170b-4a0e-48f4-9762-3cbb9618cd6a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:05.134903 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-7fc4170b-4a0e-48f4-9762-3cbb9618cd6a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lazy-loading 'services' on Instance uuid b1d33b43-1430-4d89-a575-731a73a3f50a {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:08:05.225415 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-7fc4170b-4a0e-48f4-9762-3cbb9618cd6a tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/os-volume_attachments/d52597fc-8818-42ec-9511-b49b8cca5a29" status: 202 len: 0 microversion: 2.1 time: 0.189945 Oct 04 09:08:05.225902 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 614/1274] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Oct 4 09:08:05 2022] DELETE /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/os-volume_attachments/d52597fc-8818-42ec-9511-b49b8cca5a29 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:08:05.235793 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8891b601-284e-4cb9-b782-6328c8bf99b8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:05.238024 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8891b601-284e-4cb9-b782-6328c8bf99b8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:05.244678 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8891b601-284e-4cb9-b782-6328c8bf99b8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:05.244917 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8891b601-284e-4cb9-b782-6328c8bf99b8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:05.245439 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8891b601-284e-4cb9-b782-6328c8bf99b8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:05.246112 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8891b601-284e-4cb9-b782-6328c8bf99b8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:05.246551 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8891b601-284e-4cb9-b782-6328c8bf99b8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:05.246958 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8891b601-284e-4cb9-b782-6328c8bf99b8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:05.279226 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8891b601-284e-4cb9-b782-6328c8bf99b8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047728 Oct 04 09:08:05.279787 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 661/1275] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:08:05 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:08:06.298080 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-a1ddbbe3-7f25-4f75-bc12-3db76581f012 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:06.301934 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-a1ddbbe3-7f25-4f75-bc12-3db76581f012 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:06.312435 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a1ddbbe3-7f25-4f75-bc12-3db76581f012 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:06.313230 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a1ddbbe3-7f25-4f75-bc12-3db76581f012 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:06.314013 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a1ddbbe3-7f25-4f75-bc12-3db76581f012 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:06.314727 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a1ddbbe3-7f25-4f75-bc12-3db76581f012 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:06.315173 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a1ddbbe3-7f25-4f75-bc12-3db76581f012 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:06.315592 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-a1ddbbe3-7f25-4f75-bc12-3db76581f012 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:06.347438 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-a1ddbbe3-7f25-4f75-bc12-3db76581f012 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057555 Oct 04 09:08:06.348027 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 615/1276] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:08:06 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 09:08:06.415572 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-33d922d4-7209-4c43-8c82-f9dd4c8c4eab tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:06.416484 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-33d922d4-7209-4c43-8c82-f9dd4c8c4eab tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:06.426321 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-33d922d4-7209-4c43-8c82-f9dd4c8c4eab tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:06.427074 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-33d922d4-7209-4c43-8c82-f9dd4c8c4eab tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:06.427781 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-33d922d4-7209-4c43-8c82-f9dd4c8c4eab tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:06.428638 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-33d922d4-7209-4c43-8c82-f9dd4c8c4eab tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:06.429306 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-33d922d4-7209-4c43-8c82-f9dd4c8c4eab tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:06.430005 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-33d922d4-7209-4c43-8c82-f9dd4c8c4eab tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:06.458163 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-33d922d4-7209-4c43-8c82-f9dd4c8c4eab tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Going to try to terminate instance {{(pid=142438) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:08:06.545075 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-33d922d4-7209-4c43-8c82-f9dd4c8c4eab tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 204 len: 0 microversion: 2.1 time: 0.134583 Oct 04 09:08:06.545846 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 662/1277] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:08:06 2022] DELETE /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:08:06.554550 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-39fe19ca-f144-4fe3-ade9-b0904d553e44 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:06.555159 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-39fe19ca-f144-4fe3-ade9-b0904d553e44 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:06.561345 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-39fe19ca-f144-4fe3-ade9-b0904d553e44 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:06.561826 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-39fe19ca-f144-4fe3-ade9-b0904d553e44 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:06.562265 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-39fe19ca-f144-4fe3-ade9-b0904d553e44 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:06.562953 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-39fe19ca-f144-4fe3-ade9-b0904d553e44 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:06.563403 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-39fe19ca-f144-4fe3-ade9-b0904d553e44 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:06.563837 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-39fe19ca-f144-4fe3-ade9-b0904d553e44 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:06.695580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-39fe19ca-f144-4fe3-ade9-b0904d553e44 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:08:06.703908 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-39fe19ca-f144-4fe3-ade9-b0904d553e44 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 200 len: 1681 microversion: 2.1 time: 0.153245 Oct 04 09:08:06.705437 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 616/1278] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:06 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:08:07.737066 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-37d5ed2f-f859-4de4-8d00-275dfef1ca77 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:07.738219 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-37d5ed2f-f859-4de4-8d00-275dfef1ca77 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:07.749456 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-37d5ed2f-f859-4de4-8d00-275dfef1ca77 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:07.750268 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-37d5ed2f-f859-4de4-8d00-275dfef1ca77 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:07.750987 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-37d5ed2f-f859-4de4-8d00-275dfef1ca77 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:07.751918 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-37d5ed2f-f859-4de4-8d00-275dfef1ca77 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:07.752397 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-37d5ed2f-f859-4de4-8d00-275dfef1ca77 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:07.752822 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-37d5ed2f-f859-4de4-8d00-275dfef1ca77 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:07.905498 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-37d5ed2f-f859-4de4-8d00-275dfef1ca77 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:08:07.914091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-37d5ed2f-f859-4de4-8d00-275dfef1ca77 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 200 len: 1681 microversion: 2.1 time: 0.184369 Oct 04 09:08:07.914651 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 663/1279] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:07 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:08:08.947255 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-847b06ec-4420-4a24-b732-f1336856d337 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:08.949095 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-847b06ec-4420-4a24-b732-f1336856d337 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:08.957871 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-847b06ec-4420-4a24-b732-f1336856d337 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:08.958796 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-847b06ec-4420-4a24-b732-f1336856d337 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:08.959189 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-847b06ec-4420-4a24-b732-f1336856d337 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:08.960294 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-847b06ec-4420-4a24-b732-f1336856d337 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:08.960943 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-847b06ec-4420-4a24-b732-f1336856d337 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:08.961541 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-847b06ec-4420-4a24-b732-f1336856d337 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:09.099510 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-847b06ec-4420-4a24-b732-f1336856d337 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:08:09.107559 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-847b06ec-4420-4a24-b732-f1336856d337 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 200 len: 1681 microversion: 2.1 time: 0.164321 Oct 04 09:08:09.108159 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 617/1280] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:08 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:08:09.623833 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-6970702c-a01a-4be8-bbdd-9c4c8c5d6178 req-c3943ae1-7295-4665-b531-5c42bf79c4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d33b43-1430-4d89-a575-731a73a3f50a", "name": "network-vif-deleted", "tag": "eb5e072f-d634-42c3-b6f6-1df5f304f30a"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:08:09.634858 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-6970702c-a01a-4be8-bbdd-9c4c8c5d6178 req-c3943ae1-7295-4665-b531-5c42bf79c4d5 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:09.635424 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-6970702c-a01a-4be8-bbdd-9c4c8c5d6178 req-c3943ae1-7295-4665-b531-5c42bf79c4d5 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:09.635853 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-6970702c-a01a-4be8-bbdd-9c4c8c5d6178 req-c3943ae1-7295-4665-b531-5c42bf79c4d5 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:09.647348 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-6970702c-a01a-4be8-bbdd-9c4c8c5d6178 req-c3943ae1-7295-4665-b531-5c42bf79c4d5 service nova] Creating event network-vif-deleted:eb5e072f-d634-42c3-b6f6-1df5f304f30a for instance b1d33b43-1430-4d89-a575-731a73a3f50a on hv-cinder-84456 Oct 04 09:08:09.652767 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-6970702c-a01a-4be8-bbdd-9c4c8c5d6178 req-c3943ae1-7295-4665-b531-5c42bf79c4d5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033221 Oct 04 09:08:09.653572 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 664/1281] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:08:10.192910 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1f2e28d3-1d5a-485b-a560-141e985c4318 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:10.193631 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1f2e28d3-1d5a-485b-a560-141e985c4318 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:10.200268 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1f2e28d3-1d5a-485b-a560-141e985c4318 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:10.200827 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1f2e28d3-1d5a-485b-a560-141e985c4318 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:10.201365 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1f2e28d3-1d5a-485b-a560-141e985c4318 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:10.202144 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1f2e28d3-1d5a-485b-a560-141e985c4318 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:10.202643 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1f2e28d3-1d5a-485b-a560-141e985c4318 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:10.203132 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1f2e28d3-1d5a-485b-a560-141e985c4318 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:10.235733 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1f2e28d3-1d5a-485b-a560-141e985c4318 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:10.236369 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1f2e28d3-1d5a-485b-a560-141e985c4318 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:10.236870 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1f2e28d3-1d5a-485b-a560-141e985c4318 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:10.237367 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.objects.instance [None req-1f2e28d3-1d5a-485b-a560-141e985c4318 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lazy-loading 'fault' on Instance uuid b1d33b43-1430-4d89-a575-731a73a3f50a {{(pid=142439) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:08:10.286157 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-1f2e28d3-1d5a-485b-a560-141e985c4318 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:08:10.293434 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1f2e28d3-1d5a-485b-a560-141e985c4318 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 200 len: 1332 microversion: 2.1 time: 0.166500 Oct 04 09:08:10.294452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 618/1282] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:10 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 1332 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:08:11.322019 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8a621d35-c977-439c-a782-811198356c76 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:11.323162 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-8a621d35-c977-439c-a782-811198356c76 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:11.332548 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8a621d35-c977-439c-a782-811198356c76 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:11.333022 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8a621d35-c977-439c-a782-811198356c76 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:11.333446 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8a621d35-c977-439c-a782-811198356c76 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:11.334130 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8a621d35-c977-439c-a782-811198356c76 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:11.334572 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8a621d35-c977-439c-a782-811198356c76 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:11.334985 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-8a621d35-c977-439c-a782-811198356c76 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:11.348548 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-8a621d35-c977-439c-a782-811198356c76 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] HTTP exception thrown: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8a621d35-c977-439c-a782-811198356c76 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Request method failure captured: Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a HTTP/1.1 Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_bNdsNoR1EJ0YryrP3LxGOA4CSKhOV3N2YTX5dRZGWbSMozvy9Uq2nzgH9fYhwhF5fUR2ahiSmulkP-Pv3i4rylMex1AwqCGffErBnDQcsWSLyokVVRtYTA5obgs2izUVEr7P4VXXwmn8LiZUH2LRl7KuHI9xyIQSl2BhPVU8SoXAk Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:08:11.350147 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:08:11.351682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89b56ee603d34a5f85f7e007b2fe668f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:08:11.351682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:08:11.351682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:08:11.351682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:08:11.351682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:08:11.351682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:08:11.351682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:08:11.351682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 3ec88da1704d44fb924fa3cc04e5fe25 Oct 04 09:08:11.351682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:08:11.351682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:08:11.351682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. Oct 04 09:08:11.351682 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': 'b1d33b43-1430-4d89-a575-731a73a3f50a'} Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:08:11.352590 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. Oct 04 09:08:11.353979 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:08:11.355481 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-8a621d35-c977-439c-a782-811198356c76 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Returning 404 to user: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:08:11.355481 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-8a621d35-c977-439c-a782-811198356c76 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 404 len: 111 microversion: 2.1 time: 0.037576 Oct 04 09:08:11.355481 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 665/1283] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:11 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:08:11.360719 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-6d50abee-ec65-4576-ba7c-e36f236aa497 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '.version_select at 0x7ff92e4b58b0>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:11.382748 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-6d50abee-ec65-4576-ba7c-e36f236aa497 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128623192" status: 202 len: 0 microversion: 2.1 time: 0.025912 Oct 04 09:08:11.383297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 619/1284] 10.222.0.44 () {58 vars in 1221 bytes} [Tue Oct 4 09:08:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128623192 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:08:12.010454 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-d7197017-c6f2-4fcb-b791-c26a3ca9c312 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Action: 'create', calling method: .version_select at 0x7ff92e4edaf0>, body: {"keypair": {"name": "tempest-keypair-86435789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmCNf+VgHr91nGQFrWURYLD2vi0HGe++o2GwDHLqqAyqx48r9XUe4mckeSc2nlhH2IH2JstJ02f5xAfK7nUvmmXElGM32hAcCxCl7bdJDQlTAJB09YDiXnAz19Jf7ZFsQ=="}} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:08:12.026275 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-d7197017-c6f2-4fcb-b791-c26a3ca9c312 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'key_pairs'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:08:12.030401 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.quota [None req-d7197017-c6f2-4fcb-b791-c26a3ca9c312 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for user 3ec88da1704d44fb924fa3cc04e5fe25 and project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'key_pairs'} {{(pid=142438) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:08:12.055031 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-d7197017-c6f2-4fcb-b791-c26a3ca9c312 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.048520 Oct 04 09:08:12.055646 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 666/1285] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Oct 4 09:08:12 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:08:13.323813 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-564655553", "imageRef": "99af7a03-55c1-4fbd-81a1-5f61fdf41939", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20cff610-f8c7-446f-a4a5-54f1f06f39ee"}], "security_groups": [{"name": "tempest-securitygroup--1476215312"}], "key_name": "tempest-keypair-86435789", "user_data": "}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:08:13.429695 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.network.neutron [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] validate_networks() for [('20cff610-f8c7-446f-a4a5-54f1f06f39ee', None, None, None, None, None)] {{(pid=142439) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:08:13.860482 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Flavor limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:08:13.861100 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Image limits 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:08:13.861805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Flavor pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:08:13.862508 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Image pref 0:0:0 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:08:13.863145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.virt.hardware [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142439) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:08:13.876724 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:13.877569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:13.878013 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:13.878732 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:13.879185 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:13.879604 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:13.897106 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:08:13.901152 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.quota [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Getting quotas for user 3ec88da1704d44fb924fa3cc04e5fe25 and project 89b56ee603d34a5f85f7e007b2fe668f. Resources: {'instances', 'ram', 'cores'} {{(pid=142439) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:08:13.912679 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Going to run 1 instances... {{(pid=142439) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:08:13.914955 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99af7a03-55c1-4fbd-81a1-5f61fdf41939',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142439) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:08:13.964026 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2d0abbb8-27e3-49a9-9dee-3d4753e1281c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.646798 Oct 04 09:08:13.964697 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 620/1286] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Oct 4 09:08:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 09:08:13.976471 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-952e40ba-a525-463d-8951-8309d34c85d2 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:13.977084 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-952e40ba-a525-463d-8951-8309d34c85d2 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:14.030764 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-952e40ba-a525-463d-8951-8309d34c85d2 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:08:14.038440 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-952e40ba-a525-463d-8951-8309d34c85d2 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 200 len: 1239 microversion: 2.1 time: 0.066324 Oct 04 09:08:14.039378 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 667/1287] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:13 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:08:15.062025 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b12db174-f20a-4507-850a-2be56e9788f6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:15.062732 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-b12db174-f20a-4507-850a-2be56e9788f6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:15.069184 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b12db174-f20a-4507-850a-2be56e9788f6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:15.069679 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b12db174-f20a-4507-850a-2be56e9788f6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:15.070100 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b12db174-f20a-4507-850a-2be56e9788f6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:15.070800 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b12db174-f20a-4507-850a-2be56e9788f6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:15.071247 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b12db174-f20a-4507-850a-2be56e9788f6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:15.071675 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-b12db174-f20a-4507-850a-2be56e9788f6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:15.142878 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-b12db174-f20a-4507-850a-2be56e9788f6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:08:15.151088 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b12db174-f20a-4507-850a-2be56e9788f6 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 200 len: 1299 microversion: 2.1 time: 0.093543 Oct 04 09:08:15.152063 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 621/1288] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:15 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:08:16.174645 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-4e8ae43e-c7e0-41f1-a5c8-63247db76c19 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:16.175263 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-4e8ae43e-c7e0-41f1-a5c8-63247db76c19 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:16.182237 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e8ae43e-c7e0-41f1-a5c8-63247db76c19 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:16.182717 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e8ae43e-c7e0-41f1-a5c8-63247db76c19 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:16.183142 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e8ae43e-c7e0-41f1-a5c8-63247db76c19 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:16.183829 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e8ae43e-c7e0-41f1-a5c8-63247db76c19 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:16.184312 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e8ae43e-c7e0-41f1-a5c8-63247db76c19 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:16.184728 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-4e8ae43e-c7e0-41f1-a5c8-63247db76c19 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:16.312886 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-4e8ae43e-c7e0-41f1-a5c8-63247db76c19 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:08:16.320967 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-4e8ae43e-c7e0-41f1-a5c8-63247db76c19 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 200 len: 1365 microversion: 2.1 time: 0.150244 Oct 04 09:08:16.332105 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 668/1289] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:16 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:08:16.625834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-1c2dff4f-c2f1-4cc0-8f2c-2e2539f5e33c req-498543d4-d1a4-4a12-a6ac-6514f03436aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f0405f-39cd-4543-ae9f-0acc8d0c03b3", "tag": "0eab4870-f54b-4918-9026-8df821550087"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:08:16.637213 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-1c2dff4f-c2f1-4cc0-8f2c-2e2539f5e33c req-498543d4-d1a4-4a12-a6ac-6514f03436aa service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:16.637695 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-1c2dff4f-c2f1-4cc0-8f2c-2e2539f5e33c req-498543d4-d1a4-4a12-a6ac-6514f03436aa service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:16.638124 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-1c2dff4f-c2f1-4cc0-8f2c-2e2539f5e33c req-498543d4-d1a4-4a12-a6ac-6514f03436aa service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:16.649674 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-1c2dff4f-c2f1-4cc0-8f2c-2e2539f5e33c req-498543d4-d1a4-4a12-a6ac-6514f03436aa service nova] Creating event network-changed:0eab4870-f54b-4918-9026-8df821550087 for instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 on hv-cinder-84456 Oct 04 09:08:16.654580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-1c2dff4f-c2f1-4cc0-8f2c-2e2539f5e33c req-498543d4-d1a4-4a12-a6ac-6514f03436aa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032538 Oct 04 09:08:16.655160 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 622/1290] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:08:17.348463 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-de986fc9-a452-4f85-8397-a8106659bc81 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:17.349386 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-de986fc9-a452-4f85-8397-a8106659bc81 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:17.360380 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de986fc9-a452-4f85-8397-a8106659bc81 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:17.361222 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de986fc9-a452-4f85-8397-a8106659bc81 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:17.361923 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de986fc9-a452-4f85-8397-a8106659bc81 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:17.363045 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de986fc9-a452-4f85-8397-a8106659bc81 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:17.363792 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de986fc9-a452-4f85-8397-a8106659bc81 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:17.364911 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-de986fc9-a452-4f85-8397-a8106659bc81 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:17.498895 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-de986fc9-a452-4f85-8397-a8106659bc81 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:08:17.510164 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-de986fc9-a452-4f85-8397-a8106659bc81 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 200 len: 1365 microversion: 2.1 time: 0.168031 Oct 04 09:08:17.510917 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 669/1291] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:17 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:08:18.538335 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d0b9b693-cf4f-494d-8ef9-abde4fe09b3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:18.539107 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d0b9b693-cf4f-494d-8ef9-abde4fe09b3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:18.546597 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0b9b693-cf4f-494d-8ef9-abde4fe09b3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:18.547130 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0b9b693-cf4f-494d-8ef9-abde4fe09b3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:18.547617 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0b9b693-cf4f-494d-8ef9-abde4fe09b3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:18.548429 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0b9b693-cf4f-494d-8ef9-abde4fe09b3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:18.548966 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0b9b693-cf4f-494d-8ef9-abde4fe09b3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:18.549415 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d0b9b693-cf4f-494d-8ef9-abde4fe09b3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:18.685021 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-d0b9b693-cf4f-494d-8ef9-abde4fe09b3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:08:18.692830 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d0b9b693-cf4f-494d-8ef9-abde4fe09b3b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 200 len: 1365 microversion: 2.1 time: 0.162237 Oct 04 09:08:18.693403 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 623/1292] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:18 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:08:19.719184 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-a15312b9-4677-4c5f-a205-e81e9844cd24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:19.720137 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-a15312b9-4677-4c5f-a205-e81e9844cd24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:19.731050 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a15312b9-4677-4c5f-a205-e81e9844cd24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:19.731833 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a15312b9-4677-4c5f-a205-e81e9844cd24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:19.732647 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a15312b9-4677-4c5f-a205-e81e9844cd24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:19.733798 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a15312b9-4677-4c5f-a205-e81e9844cd24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:19.734559 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a15312b9-4677-4c5f-a205-e81e9844cd24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:19.735273 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-a15312b9-4677-4c5f-a205-e81e9844cd24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:19.878135 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-a15312b9-4677-4c5f-a205-e81e9844cd24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:08:19.886221 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-a15312b9-4677-4c5f-a205-e81e9844cd24 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 200 len: 1365 microversion: 2.1 time: 0.173725 Oct 04 09:08:19.886793 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 670/1293] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:19 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:08:20.914329 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fb642187-9c63-4c94-a9b4-bd802a3829aa tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:20.914963 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-fb642187-9c63-4c94-a9b4-bd802a3829aa tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:20.921552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fb642187-9c63-4c94-a9b4-bd802a3829aa tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:20.922031 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fb642187-9c63-4c94-a9b4-bd802a3829aa tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:20.922463 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fb642187-9c63-4c94-a9b4-bd802a3829aa tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:20.923150 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fb642187-9c63-4c94-a9b4-bd802a3829aa tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:20.923601 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fb642187-9c63-4c94-a9b4-bd802a3829aa tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:20.924045 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fb642187-9c63-4c94-a9b4-bd802a3829aa tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:21.067552 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-fb642187-9c63-4c94-a9b4-bd802a3829aa tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:08:21.080601 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fb642187-9c63-4c94-a9b4-bd802a3829aa tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 200 len: 1365 microversion: 2.1 time: 0.171437 Oct 04 09:08:21.081448 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 624/1294] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:20 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:08:22.108304 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-fe988477-5e13-41b9-9dd2-0e53d801b3af tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:22.109166 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-fe988477-5e13-41b9-9dd2-0e53d801b3af tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:22.118521 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fe988477-5e13-41b9-9dd2-0e53d801b3af tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:22.119003 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fe988477-5e13-41b9-9dd2-0e53d801b3af tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:22.119430 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fe988477-5e13-41b9-9dd2-0e53d801b3af tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:22.120152 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fe988477-5e13-41b9-9dd2-0e53d801b3af tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:22.120597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fe988477-5e13-41b9-9dd2-0e53d801b3af tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:22.121013 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-fe988477-5e13-41b9-9dd2-0e53d801b3af tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:22.248922 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-fe988477-5e13-41b9-9dd2-0e53d801b3af tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:08:22.257035 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-fe988477-5e13-41b9-9dd2-0e53d801b3af tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 200 len: 1365 microversion: 2.1 time: 0.155265 Oct 04 09:08:22.257602 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 671/1295] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:22 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:08:23.283452 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-32823855-21ef-41b9-a52e-654719b2cbc8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:23.284432 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-32823855-21ef-41b9-a52e-654719b2cbc8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:23.295267 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32823855-21ef-41b9-a52e-654719b2cbc8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:23.296117 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32823855-21ef-41b9-a52e-654719b2cbc8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:23.296834 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32823855-21ef-41b9-a52e-654719b2cbc8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:23.297962 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32823855-21ef-41b9-a52e-654719b2cbc8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:23.298702 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32823855-21ef-41b9-a52e-654719b2cbc8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:23.299405 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-32823855-21ef-41b9-a52e-654719b2cbc8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:23.433338 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-32823855-21ef-41b9-a52e-654719b2cbc8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:08:23.441402 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-32823855-21ef-41b9-a52e-654719b2cbc8 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 200 len: 1365 microversion: 2.1 time: 0.164474 Oct 04 09:08:23.442011 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 625/1296] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:23 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:08:23.504234 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-1c02a5ef-33a1-4e86-8ce1-2be1c3d7738b req-b59ea7b8-0d03-4b75-9a8f-9f4583ba4978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f0405f-39cd-4543-ae9f-0acc8d0c03b3", "name": "network-vif-plugged", "status": "completed", "tag": "0eab4870-f54b-4918-9026-8df821550087"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:08:23.514463 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-1c02a5ef-33a1-4e86-8ce1-2be1c3d7738b req-b59ea7b8-0d03-4b75-9a8f-9f4583ba4978 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:23.514935 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-1c02a5ef-33a1-4e86-8ce1-2be1c3d7738b req-b59ea7b8-0d03-4b75-9a8f-9f4583ba4978 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:23.515376 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-1c02a5ef-33a1-4e86-8ce1-2be1c3d7738b req-b59ea7b8-0d03-4b75-9a8f-9f4583ba4978 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:23.527086 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-1c02a5ef-33a1-4e86-8ce1-2be1c3d7738b req-b59ea7b8-0d03-4b75-9a8f-9f4583ba4978 service nova] Creating event network-vif-plugged:0eab4870-f54b-4918-9026-8df821550087 for instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 on hv-cinder-84456 Oct 04 09:08:23.532100 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-1c02a5ef-33a1-4e86-8ce1-2be1c3d7738b req-b59ea7b8-0d03-4b75-9a8f-9f4583ba4978 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031654 Oct 04 09:08:23.532686 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 672/1297] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:08:24.469799 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-118e3942-3ef9-4f12-8c78-00360674b256 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:24.470772 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-118e3942-3ef9-4f12-8c78-00360674b256 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:24.473888 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:24.474959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell0:SELECT=6 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:24.481627 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-118e3942-3ef9-4f12-8c78-00360674b256 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:24.482099 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-118e3942-3ef9-4f12-8c78-00360674b256 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:24.482528 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-118e3942-3ef9-4f12-8c78-00360674b256 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:24.483216 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-118e3942-3ef9-4f12-8c78-00360674b256 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:24.483656 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-118e3942-3ef9-4f12-8c78-00360674b256 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:24.484106 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-118e3942-3ef9-4f12-8c78-00360674b256 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:24.613427 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-118e3942-3ef9-4f12-8c78-00360674b256 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:08:24.621767 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-118e3942-3ef9-4f12-8c78-00360674b256 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 200 len: 1365 microversion: 2.1 time: 0.158956 Oct 04 09:08:24.622316 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 626/1298] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:24 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:08:25.642414 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell0:SELECT=6 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:25.647155 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-77edcd26-8792-4c9d-ac5c-1bc0d67b5287 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:25.647861 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-77edcd26-8792-4c9d-ac5c-1bc0d67b5287 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:25.649759 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:25.655397 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-77edcd26-8792-4c9d-ac5c-1bc0d67b5287 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:25.655896 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-77edcd26-8792-4c9d-ac5c-1bc0d67b5287 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:25.656346 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-77edcd26-8792-4c9d-ac5c-1bc0d67b5287 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:25.657093 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-77edcd26-8792-4c9d-ac5c-1bc0d67b5287 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:25.657549 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-77edcd26-8792-4c9d-ac5c-1bc0d67b5287 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:25.657972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-77edcd26-8792-4c9d-ac5c-1bc0d67b5287 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:25.661142 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:25.817221 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-77edcd26-8792-4c9d-ac5c-1bc0d67b5287 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:08:25.825647 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-77edcd26-8792-4c9d-ac5c-1bc0d67b5287 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 200 len: 1556 microversion: 2.1 time: 0.184324 Oct 04 09:08:25.826216 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 673/1299] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:08:25 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 1556 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:08:25.850868 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-d98bdeb0-1a96-41d6-ad99-b2dd62c8703f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:08:25.851446 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-d98bdeb0-1a96-41d6-ad99-b2dd62c8703f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:08:25.861603 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d98bdeb0-1a96-41d6-ad99-b2dd62c8703f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:25.862345 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d98bdeb0-1a96-41d6-ad99-b2dd62c8703f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:25.862942 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d98bdeb0-1a96-41d6-ad99-b2dd62c8703f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:25.864032 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d98bdeb0-1a96-41d6-ad99-b2dd62c8703f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:25.865050 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d98bdeb0-1a96-41d6-ad99-b2dd62c8703f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:25.865655 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-d98bdeb0-1a96-41d6-ad99-b2dd62c8703f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:25.947798 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-d98bdeb0-1a96-41d6-ad99-b2dd62c8703f tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103052 Oct 04 09:08:25.948444 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 627/1300] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Oct 4 09:08:25 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:08:27.147283 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-f4dd6a4b-0a91-4454-9cf5-a18c0117c28a req-8d70127a-c48c-4849-8e3a-84930fe4d234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f0405f-39cd-4543-ae9f-0acc8d0c03b3", "tag": "0eab4870-f54b-4918-9026-8df821550087"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:08:27.157000 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-f4dd6a4b-0a91-4454-9cf5-a18c0117c28a req-8d70127a-c48c-4849-8e3a-84930fe4d234 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:08:27.157466 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-f4dd6a4b-0a91-4454-9cf5-a18c0117c28a req-8d70127a-c48c-4849-8e3a-84930fe4d234 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:08:27.157886 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-f4dd6a4b-0a91-4454-9cf5-a18c0117c28a req-8d70127a-c48c-4849-8e3a-84930fe4d234 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:08:27.169032 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-f4dd6a4b-0a91-4454-9cf5-a18c0117c28a req-8d70127a-c48c-4849-8e3a-84930fe4d234 service nova] Creating event network-changed:0eab4870-f54b-4918-9026-8df821550087 for instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 on hv-cinder-84456 Oct 04 09:08:27.174428 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-f4dd6a4b-0a91-4454-9cf5-a18c0117c28a req-8d70127a-c48c-4849-8e3a-84930fe4d234 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030435 Oct 04 09:08:27.175793 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 674/1301] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:09:13.845218 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-855d2843-b31f-49a2-a6b7-06ed825e52a7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:13.845785 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-855d2843-b31f-49a2-a6b7-06ed825e52a7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:13.847271 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [req-f11a11ea-e16b-4277-8d9d-cf54dc9f0014 req-69f133c2-0904-4c5f-aefa-e88cac7fddda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a22dc3-e2b5-48af-a968-ca6ecdfc50e8", "tag": "8d2a9d8b-a2ca-4a6d-b218-6582fd84af52"}]} {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:09:13.848554 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:09:13.849568 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:09:13.854139 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=3 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:09:13.854780 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=7 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:09:13.856838 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-855d2843-b31f-49a2-a6b7-06ed825e52a7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:13.857571 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-855d2843-b31f-49a2-a6b7-06ed825e52a7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:13.858089 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-855d2843-b31f-49a2-a6b7-06ed825e52a7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:13.858797 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-855d2843-b31f-49a2-a6b7-06ed825e52a7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:13.859518 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-855d2843-b31f-49a2-a6b7-06ed825e52a7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:13.860183 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-855d2843-b31f-49a2-a6b7-06ed825e52a7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:13.861424 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-f11a11ea-e16b-4277-8d9d-cf54dc9f0014 req-69f133c2-0904-4c5f-aefa-e88cac7fddda service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:13.861897 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-f11a11ea-e16b-4277-8d9d-cf54dc9f0014 req-69f133c2-0904-4c5f-aefa-e88cac7fddda service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:13.862544 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [req-f11a11ea-e16b-4277-8d9d-cf54dc9f0014 req-69f133c2-0904-4c5f-aefa-e88cac7fddda service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:13.875582 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.compute.server_external_events [req-f11a11ea-e16b-4277-8d9d-cf54dc9f0014 req-69f133c2-0904-4c5f-aefa-e88cac7fddda service nova] Creating event network-changed:8d2a9d8b-a2ca-4a6d-b218-6582fd84af52 for instance 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 on hv-cinder-84456 Oct 04 09:09:13.881118 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [req-f11a11ea-e16b-4277-8d9d-cf54dc9f0014 req-69f133c2-0904-4c5f-aefa-e88cac7fddda service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037806 Oct 04 09:09:13.882538 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 675/1302] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:09:13.891287 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-855d2843-b31f-49a2-a6b7-06ed825e52a7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Going to try to terminate instance {{(pid=142439) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:09:13.986514 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-855d2843-b31f-49a2-a6b7-06ed825e52a7 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "DELETE /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 204 len: 0 microversion: 2.1 time: 0.145154 Oct 04 09:09:13.987607 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 628/1303] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:09:13 2022] DELETE /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:09:13.996940 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-017b301f-8c93-4d2f-9d97-09f78e56bf3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:13.997634 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-017b301f-8c93-4d2f-9d97-09f78e56bf3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:14.004238 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-017b301f-8c93-4d2f-9d97-09f78e56bf3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:14.004713 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-017b301f-8c93-4d2f-9d97-09f78e56bf3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:14.005129 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-017b301f-8c93-4d2f-9d97-09f78e56bf3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:14.005814 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-017b301f-8c93-4d2f-9d97-09f78e56bf3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:14.006255 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-017b301f-8c93-4d2f-9d97-09f78e56bf3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:14.007256 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-017b301f-8c93-4d2f-9d97-09f78e56bf3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:14.142606 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-017b301f-8c93-4d2f-9d97-09f78e56bf3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:09:14.150650 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-017b301f-8c93-4d2f-9d97-09f78e56bf3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.158121 Oct 04 09:09:14.151214 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 676/1304] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:09:13 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:09:15.176398 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-2a873dd6-825a-454a-9c78-c28329de4566 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:15.177502 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-2a873dd6-825a-454a-9c78-c28329de4566 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:15.185580 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2a873dd6-825a-454a-9c78-c28329de4566 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:15.186174 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2a873dd6-825a-454a-9c78-c28329de4566 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:15.186593 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2a873dd6-825a-454a-9c78-c28329de4566 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:15.187323 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2a873dd6-825a-454a-9c78-c28329de4566 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:15.187779 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2a873dd6-825a-454a-9c78-c28329de4566 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:15.188245 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-2a873dd6-825a-454a-9c78-c28329de4566 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:15.323411 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-2a873dd6-825a-454a-9c78-c28329de4566 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:09:15.331516 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-2a873dd6-825a-454a-9c78-c28329de4566 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1570 microversion: 2.1 time: 0.161369 Oct 04 09:09:15.332119 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 629/1305] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:09:15 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:09:16.354876 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f187d618-3650-4f6e-a3b4-17f4bba57ee5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:16.355480 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f187d618-3650-4f6e-a3b4-17f4bba57ee5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:16.369345 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f187d618-3650-4f6e-a3b4-17f4bba57ee5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:16.369838 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f187d618-3650-4f6e-a3b4-17f4bba57ee5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:16.370237 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f187d618-3650-4f6e-a3b4-17f4bba57ee5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:16.370975 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f187d618-3650-4f6e-a3b4-17f4bba57ee5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:16.371455 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f187d618-3650-4f6e-a3b4-17f4bba57ee5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:16.371879 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f187d618-3650-4f6e-a3b4-17f4bba57ee5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:16.508275 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-f187d618-3650-4f6e-a3b4-17f4bba57ee5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cfec539e6dc404fa692139310733d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3592efc4ea4562a7b38a9189c7d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:09:16.522142 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f187d618-3650-4f6e-a3b4-17f4bba57ee5 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 200 len: 1451 microversion: 2.1 time: 0.171160 Oct 04 09:09:16.522762 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 677/1306] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:09:16 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:09:16.559363 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-845cf366-95bd-4567-bd08-dffa56bcd695 req-dc1f5ce4-2d22-4a86-9a20-8c4e33489ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a22dc3-e2b5-48af-a968-ca6ecdfc50e8", "name": "network-vif-deleted", "tag": "8d2a9d8b-a2ca-4a6d-b218-6582fd84af52"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:09:16.569893 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-845cf366-95bd-4567-bd08-dffa56bcd695 req-dc1f5ce4-2d22-4a86-9a20-8c4e33489ca9 service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:16.570371 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-845cf366-95bd-4567-bd08-dffa56bcd695 req-dc1f5ce4-2d22-4a86-9a20-8c4e33489ca9 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:16.570884 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-845cf366-95bd-4567-bd08-dffa56bcd695 req-dc1f5ce4-2d22-4a86-9a20-8c4e33489ca9 service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:16.582417 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-845cf366-95bd-4567-bd08-dffa56bcd695 req-dc1f5ce4-2d22-4a86-9a20-8c4e33489ca9 service nova] Creating event network-vif-deleted:8d2a9d8b-a2ca-4a6d-b218-6582fd84af52 for instance 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 on hv-cinder-84456 Oct 04 09:09:16.587259 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-845cf366-95bd-4567-bd08-dffa56bcd695 req-dc1f5ce4-2d22-4a86-9a20-8c4e33489ca9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031681 Oct 04 09:09:16.587852 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 630/1307] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:09:17.546752 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f4953f3e-b970-46f8-bb1c-001c3b6ddc3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:17.547356 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f4953f3e-b970-46f8-bb1c-001c3b6ddc3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] [instance: 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:17.554150 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4953f3e-b970-46f8-bb1c-001c3b6ddc3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:17.554633 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4953f3e-b970-46f8-bb1c-001c3b6ddc3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:17.555043 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4953f3e-b970-46f8-bb1c-001c3b6ddc3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:17.555743 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4953f3e-b970-46f8-bb1c-001c3b6ddc3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:17.556238 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4953f3e-b970-46f8-bb1c-001c3b6ddc3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:17.556664 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f4953f3e-b970-46f8-bb1c-001c3b6ddc3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:17.570442 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-f4953f3e-b970-46f8-bb1c-001c3b6ddc3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] HTTP exception thrown: Instance 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 could not be found. Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f4953f3e-b970-46f8-bb1c-001c3b6ddc3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Request method failure captured: Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 HTTP/1.1 Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_cCA3bHsCiN_MwKJhChpl-EQkfAlIzK_YObOGeTeVzcnIaZvb0pppfLIwlVwssV1XqMmJZ5iQYv7WPCoS-THRlDPsJ8LSNK1mOuPJ21jw1hnbAg1wHvHPBcIVTEnfrYaZ2cW3YDs66EjzC4WIZxVDpYFg0VoWuZHykvS_xFBbma2ts Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 1c3592efc4ea4562a7b38a9189c7d04f Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-TestShelveInstance-1494092163 Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:09:17.572156 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:09:17.574028 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c3592efc4ea4562a7b38a9189c7d04f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c3592efc4ea4562a7b38a9189c7d04f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c3592efc4ea4562a7b38a9189c7d04f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c3592efc4ea4562a7b38a9189c7d04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:09:17.574028 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-TestShelveInstance-1494092163 Oct 04 09:09:17.574028 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 1c3592efc4ea4562a7b38a9189c7d04f Oct 04 09:09:17.574028 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-TestShelveInstance-1494092163 Oct 04 09:09:17.574028 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-TestShelveInstance-1494092163-project Oct 04 09:09:17.574028 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:09:17.574028 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:09:17.574028 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 6cfec539e6dc404fa692139310733d31 Oct 04 09:09:17.574028 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-TestShelveInstance-1494092163-project Oct 04 09:09:17.574028 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:09:17.574028 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 could not be found. Oct 04 09:09:17.574028 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': '76a22dc3-e2b5-48af-a968-ca6ecdfc50e8'} Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 could not be found. Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:09:17.575091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 could not be found. Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 could not be found. Oct 04 09:09:17.576875 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:17.579259 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f4953f3e-b970-46f8-bb1c-001c3b6ddc3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Returning 404 to user: Instance 76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:09:17.579259 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f4953f3e-b970-46f8-bb1c-001c3b6ddc3e tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8" status: 404 len: 111 microversion: 2.1 time: 0.030825 Oct 04 09:09:17.579259 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 678/1308] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:09:17 2022] GET /compute/v2.1/servers/76a22dc3-e2b5-48af-a968-ca6ecdfc50e8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:09:17.752347 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-ef6dc762-2bfa-4728-bbde-63dae4b91746 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] Calling method '.version_select at 0x7ff92e4d38b0>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:17.775314 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-ef6dc762-2bfa-4728-bbde-63dae4b91746 tempest-TestShelveInstance-1494092163 tempest-TestShelveInstance-1494092163-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1659556079" status: 202 len: 0 microversion: 2.1 time: 0.027491 Oct 04 09:09:17.775953 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 631/1309] 10.222.0.44 () {58 vars in 1254 bytes} [Tue Oct 4 09:09:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1659556079 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:09:30.542046 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-b05c04f5-3fb8-407e-bcea-c6d16af09a49 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:30.543053 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-b05c04f5-3fb8-407e-bcea-c6d16af09a49 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:30.546400 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_api:SELECT=8 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:09:30.547451 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG dbcounter [-] [142438] Writing DB stats nova_cell1:SELECT=16 {{(pid=142438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:09:30.557397 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b05c04f5-3fb8-407e-bcea-c6d16af09a49 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:30.558210 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b05c04f5-3fb8-407e-bcea-c6d16af09a49 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:30.558920 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b05c04f5-3fb8-407e-bcea-c6d16af09a49 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:30.560091 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b05c04f5-3fb8-407e-bcea-c6d16af09a49 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:30.560892 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b05c04f5-3fb8-407e-bcea-c6d16af09a49 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:30.561588 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-b05c04f5-3fb8-407e-bcea-c6d16af09a49 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:30.586198 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-b05c04f5-3fb8-407e-bcea-c6d16af09a49 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3/ips" status: 200 len: 151 microversion: 2.1 time: 0.051097 Oct 04 09:09:30.586775 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 679/1310] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Oct 4 09:09:30 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3/ips => generated 151 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:09:31.966088 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:09:31.966835 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG dbcounter [-] [142439] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=142439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:09:31.971203 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-fb29dabc-2361-45fc-be94-f3cb64bd8d58 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ca7f90d-7eb5-41c1-8b1e-a45e1aadcaed"}} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:09:31.973839 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-fb29dabc-2361-45fc-be94-f3cb64bd8d58 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:31.982411 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fb29dabc-2361-45fc-be94-f3cb64bd8d58 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:31.982889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fb29dabc-2361-45fc-be94-f3cb64bd8d58 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:31.983347 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fb29dabc-2361-45fc-be94-f3cb64bd8d58 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:31.984053 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fb29dabc-2361-45fc-be94-f3cb64bd8d58 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:31.984500 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fb29dabc-2361-45fc-be94-f3cb64bd8d58 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:31.984911 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-fb29dabc-2361-45fc-be94-f3cb64bd8d58 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:32.280373 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-fb29dabc-2361-45fc-be94-f3cb64bd8d58 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "POST /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315295 Oct 04 09:09:32.281087 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 632/1311] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Oct 4 09:09:31 2022] POST /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:09:40.008560 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f5ac3904-e06d-4474-bf4e-703297bb713b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:40.009149 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f5ac3904-e06d-4474-bf4e-703297bb713b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:40.015764 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f5ac3904-e06d-4474-bf4e-703297bb713b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:40.016296 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f5ac3904-e06d-4474-bf4e-703297bb713b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:40.016736 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f5ac3904-e06d-4474-bf4e-703297bb713b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:40.017498 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f5ac3904-e06d-4474-bf4e-703297bb713b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:40.017884 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f5ac3904-e06d-4474-bf4e-703297bb713b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:40.018305 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f5ac3904-e06d-4474-bf4e-703297bb713b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:40.101530 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.objects.instance [None req-f5ac3904-e06d-4474-bf4e-703297bb713b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lazy-loading 'services' on Instance uuid b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 {{(pid=142438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:09:40.180263 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f5ac3904-e06d-4474-bf4e-703297bb713b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3/os-volume_attachments/5ca7f90d-7eb5-41c1-8b1e-a45e1aadcaed" status: 202 len: 0 microversion: 2.1 time: 0.175745 Oct 04 09:09:40.180922 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 680/1312] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Oct 4 09:09:40 2022] DELETE /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3/os-volume_attachments/5ca7f90d-7eb5-41c1-8b1e-a45e1aadcaed => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:09:40.190750 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-77d5dc95-1776-4317-b191-635a1797299b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:40.193141 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-77d5dc95-1776-4317-b191-635a1797299b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:40.200526 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-77d5dc95-1776-4317-b191-635a1797299b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:40.201041 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-77d5dc95-1776-4317-b191-635a1797299b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:40.201468 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-77d5dc95-1776-4317-b191-635a1797299b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:40.202208 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-77d5dc95-1776-4317-b191-635a1797299b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:40.203456 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-77d5dc95-1776-4317-b191-635a1797299b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:40.203924 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-77d5dc95-1776-4317-b191-635a1797299b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:40.236198 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-77d5dc95-1776-4317-b191-635a1797299b tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050480 Oct 04 09:09:40.236776 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 633/1313] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:09:40 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:09:41.254684 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-1eb644a8-ad9c-4278-9b27-79513d086f40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:41.258651 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-1eb644a8-ad9c-4278-9b27-79513d086f40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:41.265180 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1eb644a8-ad9c-4278-9b27-79513d086f40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:41.265654 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1eb644a8-ad9c-4278-9b27-79513d086f40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:41.266152 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1eb644a8-ad9c-4278-9b27-79513d086f40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:41.266829 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1eb644a8-ad9c-4278-9b27-79513d086f40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:41.267273 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1eb644a8-ad9c-4278-9b27-79513d086f40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:41.267684 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-1eb644a8-ad9c-4278-9b27-79513d086f40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:41.297664 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-1eb644a8-ad9c-4278-9b27-79513d086f40 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051446 Oct 04 09:09:41.298200 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 681/1314] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Oct 4 09:09:41 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 09:09:41.371247 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-202ed0b6-5c55-4e46-aef2-f6c0df09ed1c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:41.371807 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-202ed0b6-5c55-4e46-aef2-f6c0df09ed1c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:41.378311 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-202ed0b6-5c55-4e46-aef2-f6c0df09ed1c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:41.378805 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-202ed0b6-5c55-4e46-aef2-f6c0df09ed1c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:41.379236 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-202ed0b6-5c55-4e46-aef2-f6c0df09ed1c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:41.379952 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-202ed0b6-5c55-4e46-aef2-f6c0df09ed1c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:41.380423 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-202ed0b6-5c55-4e46-aef2-f6c0df09ed1c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:41.380844 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-202ed0b6-5c55-4e46-aef2-f6c0df09ed1c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:41.405998 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-202ed0b6-5c55-4e46-aef2-f6c0df09ed1c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Going to try to terminate instance {{(pid=142439) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:09:41.485569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-202ed0b6-5c55-4e46-aef2-f6c0df09ed1c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 204 len: 0 microversion: 2.1 time: 0.118019 Oct 04 09:09:41.486218 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 634/1315] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:09:41 2022] DELETE /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:09:41.496133 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-acec624a-09b1-4426-ba04-a0364e027646 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:41.496746 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-acec624a-09b1-4426-ba04-a0364e027646 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:41.502754 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-acec624a-09b1-4426-ba04-a0364e027646 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:41.503218 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-acec624a-09b1-4426-ba04-a0364e027646 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:41.503647 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-acec624a-09b1-4426-ba04-a0364e027646 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:41.504358 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-acec624a-09b1-4426-ba04-a0364e027646 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:41.504856 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-acec624a-09b1-4426-ba04-a0364e027646 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:41.505214 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-acec624a-09b1-4426-ba04-a0364e027646 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:41.641157 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-acec624a-09b1-4426-ba04-a0364e027646 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:09:41.649603 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-acec624a-09b1-4426-ba04-a0364e027646 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 200 len: 1681 microversion: 2.1 time: 0.157862 Oct 04 09:09:41.650175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 682/1316] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:09:41 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:09:42.678301 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-9b24509c-08de-4584-9f5a-6ea80f8b3a52 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:42.679390 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-9b24509c-08de-4584-9f5a-6ea80f8b3a52 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:42.690461 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b24509c-08de-4584-9f5a-6ea80f8b3a52 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:42.691305 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b24509c-08de-4584-9f5a-6ea80f8b3a52 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:42.692066 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b24509c-08de-4584-9f5a-6ea80f8b3a52 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:42.693200 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b24509c-08de-4584-9f5a-6ea80f8b3a52 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:42.693943 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b24509c-08de-4584-9f5a-6ea80f8b3a52 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:42.694639 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-9b24509c-08de-4584-9f5a-6ea80f8b3a52 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:42.834606 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.policy [None req-9b24509c-08de-4584-9f5a-6ea80f8b3a52 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142439) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:09:42.842739 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-9b24509c-08de-4584-9f5a-6ea80f8b3a52 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 200 len: 1681 microversion: 2.1 time: 0.171707 Oct 04 09:09:42.843314 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 635/1317] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:09:42 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:09:43.870316 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-5dae3baa-b65b-4b41-bf90-1a547115fd89 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:43.870982 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-5dae3baa-b65b-4b41-bf90-1a547115fd89 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:43.878961 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5dae3baa-b65b-4b41-bf90-1a547115fd89 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:43.879439 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5dae3baa-b65b-4b41-bf90-1a547115fd89 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:43.880121 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5dae3baa-b65b-4b41-bf90-1a547115fd89 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:43.880824 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5dae3baa-b65b-4b41-bf90-1a547115fd89 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:43.881298 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5dae3baa-b65b-4b41-bf90-1a547115fd89 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:43.881718 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-5dae3baa-b65b-4b41-bf90-1a547115fd89 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:43.950386 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.policy [None req-5dae3baa-b65b-4b41-bf90-1a547115fd89 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec88da1704d44fb924fa3cc04e5fe25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b56ee603d34a5f85f7e007b2fe668f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142438) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:09:43.958727 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-5dae3baa-b65b-4b41-bf90-1a547115fd89 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 200 len: 1613 microversion: 2.1 time: 0.094311 Oct 04 09:09:43.959300 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 683/1318] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:09:43 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 1613 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:09:44.426151 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [req-bb7f79f1-150d-4457-9ca7-a587eb52ff5d req-70e900c8-d6cf-4e29-9627-23476ab23c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f0405f-39cd-4543-ae9f-0acc8d0c03b3", "name": "network-vif-deleted", "tag": "0eab4870-f54b-4918-9026-8df821550087"}]} {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:09:44.442309 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-bb7f79f1-150d-4457-9ca7-a587eb52ff5d req-70e900c8-d6cf-4e29-9627-23476ab23c5e service nova] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:44.442782 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-bb7f79f1-150d-4457-9ca7-a587eb52ff5d req-70e900c8-d6cf-4e29-9627-23476ab23c5e service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:44.443203 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [req-bb7f79f1-150d-4457-9ca7-a587eb52ff5d req-70e900c8-d6cf-4e29-9627-23476ab23c5e service nova] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:44.457890 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.compute.server_external_events [req-bb7f79f1-150d-4457-9ca7-a587eb52ff5d req-70e900c8-d6cf-4e29-9627-23476ab23c5e service nova] Creating event network-vif-deleted:0eab4870-f54b-4918-9026-8df821550087 for instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 on hv-cinder-84456 Oct 04 09:09:44.464100 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [req-bb7f79f1-150d-4457-9ca7-a587eb52ff5d req-70e900c8-d6cf-4e29-9627-23476ab23c5e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280555 Oct 04 09:09:44.465029 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 636/1319] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Oct 4 09:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:09:44.982798 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f9ecba33-de22-4625-b653-70ad162c33c5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:44.983411 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f9ecba33-de22-4625-b653-70ad162c33c5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:44.991610 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f9ecba33-de22-4625-b653-70ad162c33c5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:44.992163 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f9ecba33-de22-4625-b653-70ad162c33c5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:44.992577 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f9ecba33-de22-4625-b653-70ad162c33c5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:44.993318 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f9ecba33-de22-4625-b653-70ad162c33c5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:44.993774 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f9ecba33-de22-4625-b653-70ad162c33c5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:44.994170 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f9ecba33-de22-4625-b653-70ad162c33c5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:45.010613 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-f9ecba33-de22-4625-b653-70ad162c33c5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] HTTP exception thrown: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f9ecba33-de22-4625-b653-70ad162c33c5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Request method failure captured: Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 HTTP/1.1 Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_bNdsNoR1EJ0YryrP3LxGOA4CSKhOV3N2YTX5dRZGWbSMozvy9Uq2nzgH9fYhwhF5fUR2ahiSmulkP-Pv3i4rylMex1AwqCGffErBnDQcsWSLyokVVRtYTA5obgs2izUVEr7P4VXXwmn8LiZUH2LRl7KuHI9xyIQSl2BhPVU8SoXAk Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:09:45.012362 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:09:45.014108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89b56ee603d34a5f85f7e007b2fe668f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:09:45.014108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:45.014108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:45.014108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:45.014108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:45.014108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:09:45.014108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:09:45.014108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 3ec88da1704d44fb924fa3cc04e5fe25 Oct 04 09:09:45.014108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:45.014108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:09:45.014108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. Oct 04 09:09:45.014108 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': 'b7f0405f-39cd-4543-ae9f-0acc8d0c03b3'} Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:09:45.015122 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. Oct 04 09:09:45.016612 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:45.017923 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f9ecba33-de22-4625-b653-70ad162c33c5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Returning 404 to user: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:09:45.017923 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f9ecba33-de22-4625-b653-70ad162c33c5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 404 len: 111 microversion: 2.1 time: 0.035984 Oct 04 09:09:45.017923 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 684/1320] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:09:44 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:09:45.024762 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-b629040c-7d45-444e-b0cd-dfa534430a1d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '.version_select at 0x7ff92e7063a0>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:45.046734 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-b629040c-7d45-444e-b0cd-dfa534430a1d tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-86435789" status: 202 len: 0 microversion: 2.1 time: 0.026322 Oct 04 09:09:45.047329 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 637/1321] 10.222.0.44 () {58 vars in 1215 bytes} [Tue Oct 4 09:09:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-86435789 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:09:46.818623 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f056fcb6-8b61-48c4-bdc4-c76edbbadf5c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:46.819123 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-f056fcb6-8b61-48c4-bdc4-c76edbbadf5c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:46.825753 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f056fcb6-8b61-48c4-bdc4-c76edbbadf5c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:46.826240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f056fcb6-8b61-48c4-bdc4-c76edbbadf5c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:46.826673 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f056fcb6-8b61-48c4-bdc4-c76edbbadf5c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:46.827366 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f056fcb6-8b61-48c4-bdc4-c76edbbadf5c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:46.827816 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f056fcb6-8b61-48c4-bdc4-c76edbbadf5c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:46.828270 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-f056fcb6-8b61-48c4-bdc4-c76edbbadf5c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:46.842180 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-f056fcb6-8b61-48c4-bdc4-c76edbbadf5c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] HTTP exception thrown: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f056fcb6-8b61-48c4-bdc4-c76edbbadf5c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Request method failure captured: Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: DELETE /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 HTTP/1.1 Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_bNdsNoR1EJ0YryrP3LxGOA4CSKhOV3N2YTX5dRZGWbSMozvy9Uq2nzgH9fYhwhF5fUR2ahiSmulkP-Pv3i4rylMex1AwqCGffErBnDQcsWSLyokVVRtYTA5obgs2izUVEr7P4VXXwmn8LiZUH2LRl7KuHI9xyIQSl2BhPVU8SoXAk Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:09:46.843763 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:09:46.845375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89b56ee603d34a5f85f7e007b2fe668f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:09:46.845375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:46.845375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:46.845375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:46.845375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:46.845375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:09:46.845375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:09:46.845375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 3ec88da1704d44fb924fa3cc04e5fe25 Oct 04 09:09:46.845375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:46.845375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:09:46.845375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. Oct 04 09:09:46.845375 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': 'b7f0405f-39cd-4543-ae9f-0acc8d0c03b3'} Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:09:46.846240 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. Oct 04 09:09:46.847832 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:46.849892 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-f056fcb6-8b61-48c4-bdc4-c76edbbadf5c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Returning 404 to user: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:09:46.849892 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-f056fcb6-8b61-48c4-bdc4-c76edbbadf5c tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 404 len: 111 microversion: 2.1 time: 0.030535 Oct 04 09:09:46.849892 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 685/1322] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:09:46 2022] DELETE /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:09:46.854849 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1d07f25b-6fbd-44c8-b1b8-ccb5e56f4163 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:46.855585 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-1d07f25b-6fbd-44c8-b1b8-ccb5e56f4163 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b7f0405f-39cd-4543-ae9f-0acc8d0c03b3] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:46.862890 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1d07f25b-6fbd-44c8-b1b8-ccb5e56f4163 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:46.863366 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1d07f25b-6fbd-44c8-b1b8-ccb5e56f4163 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:46.863803 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1d07f25b-6fbd-44c8-b1b8-ccb5e56f4163 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:46.864860 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1d07f25b-6fbd-44c8-b1b8-ccb5e56f4163 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:46.865320 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1d07f25b-6fbd-44c8-b1b8-ccb5e56f4163 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:46.865746 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-1d07f25b-6fbd-44c8-b1b8-ccb5e56f4163 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:46.879008 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-1d07f25b-6fbd-44c8-b1b8-ccb5e56f4163 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] HTTP exception thrown: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1d07f25b-6fbd-44c8-b1b8-ccb5e56f4163 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Request method failure captured: Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 HTTP/1.1 Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_bNdsNoR1EJ0YryrP3LxGOA4CSKhOV3N2YTX5dRZGWbSMozvy9Uq2nzgH9fYhwhF5fUR2ahiSmulkP-Pv3i4rylMex1AwqCGffErBnDQcsWSLyokVVRtYTA5obgs2izUVEr7P4VXXwmn8LiZUH2LRl7KuHI9xyIQSl2BhPVU8SoXAk Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:09:46.880670 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:09:46.882660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89b56ee603d34a5f85f7e007b2fe668f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:09:46.882660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:46.882660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:46.882660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:46.882660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:46.882660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:09:46.882660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:09:46.882660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 3ec88da1704d44fb924fa3cc04e5fe25 Oct 04 09:09:46.882660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:46.882660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:09:46.882660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. Oct 04 09:09:46.882660 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': 'b7f0405f-39cd-4543-ae9f-0acc8d0c03b3'} Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:09:46.883669 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. Oct 04 09:09:46.885297 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:46.886769 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-1d07f25b-6fbd-44c8-b1b8-ccb5e56f4163 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Returning 404 to user: Instance b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:09:46.886769 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-1d07f25b-6fbd-44c8-b1b8-ccb5e56f4163 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3" status: 404 len: 111 microversion: 2.1 time: 0.032220 Oct 04 09:09:46.886769 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 638/1323] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:09:46 2022] GET /compute/v2.1/servers/b7f0405f-39cd-4543-ae9f-0acc8d0c03b3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:09:48.036425 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-86185256-be57-4a4f-b859-d9e4bf0de1e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:48.037192 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-86185256-be57-4a4f-b859-d9e4bf0de1e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:48.047597 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-86185256-be57-4a4f-b859-d9e4bf0de1e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:48.048414 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-86185256-be57-4a4f-b859-d9e4bf0de1e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:48.048869 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-86185256-be57-4a4f-b859-d9e4bf0de1e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:48.049851 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-86185256-be57-4a4f-b859-d9e4bf0de1e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:48.050596 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-86185256-be57-4a4f-b859-d9e4bf0de1e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:48.051281 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-86185256-be57-4a4f-b859-d9e4bf0de1e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:48.066470 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-86185256-be57-4a4f-b859-d9e4bf0de1e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] HTTP exception thrown: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-86185256-be57-4a4f-b859-d9e4bf0de1e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Request method failure captured: Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: DELETE /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a HTTP/1.1 Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_bNdsNoR1EJ0YryrP3LxGOA4CSKhOV3N2YTX5dRZGWbSMozvy9Uq2nzgH9fYhwhF5fUR2ahiSmulkP-Pv3i4rylMex1AwqCGffErBnDQcsWSLyokVVRtYTA5obgs2izUVEr7P4VXXwmn8LiZUH2LRl7KuHI9xyIQSl2BhPVU8SoXAk Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:09:48.068158 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:09:48.069980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89b56ee603d34a5f85f7e007b2fe668f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:09:48.069980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:48.069980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:48.069980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:48.069980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:48.069980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:09:48.069980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:09:48.069980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 3ec88da1704d44fb924fa3cc04e5fe25 Oct 04 09:09:48.069980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:48.069980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:09:48.069980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. Oct 04 09:09:48.069980 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': 'b1d33b43-1430-4d89-a575-731a73a3f50a'} Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:09:48.070900 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. Oct 04 09:09:48.072528 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.074140 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-86185256-be57-4a4f-b859-d9e4bf0de1e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Returning 404 to user: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:09:48.074140 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-86185256-be57-4a4f-b859-d9e4bf0de1e5 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 404 len: 111 microversion: 2.1 time: 0.039718 Oct 04 09:09:48.074140 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 686/1324] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:09:48 2022] DELETE /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:09:48.078106 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-29375d93-d5fc-4286-8fc5-4aab673cc586 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:48.078716 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-29375d93-d5fc-4286-8fc5-4aab673cc586 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: b1d33b43-1430-4d89-a575-731a73a3f50a] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:48.085319 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-29375d93-d5fc-4286-8fc5-4aab673cc586 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:48.085791 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-29375d93-d5fc-4286-8fc5-4aab673cc586 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:48.086220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-29375d93-d5fc-4286-8fc5-4aab673cc586 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:48.086992 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-29375d93-d5fc-4286-8fc5-4aab673cc586 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:48.087409 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-29375d93-d5fc-4286-8fc5-4aab673cc586 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:48.087856 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-29375d93-d5fc-4286-8fc5-4aab673cc586 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:48.102252 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-29375d93-d5fc-4286-8fc5-4aab673cc586 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] HTTP exception thrown: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-29375d93-d5fc-4286-8fc5-4aab673cc586 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Request method failure captured: Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a HTTP/1.1 Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_bNdsNoR1EJ0YryrP3LxGOA4CSKhOV3N2YTX5dRZGWbSMozvy9Uq2nzgH9fYhwhF5fUR2ahiSmulkP-Pv3i4rylMex1AwqCGffErBnDQcsWSLyokVVRtYTA5obgs2izUVEr7P4VXXwmn8LiZUH2LRl7KuHI9xyIQSl2BhPVU8SoXAk Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:09:48.104139 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:09:48.105692 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89b56ee603d34a5f85f7e007b2fe668f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:09:48.105692 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:48.105692 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:48.105692 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:48.105692 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:48.105692 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:09:48.105692 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:09:48.105692 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 3ec88da1704d44fb924fa3cc04e5fe25 Oct 04 09:09:48.105692 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:48.105692 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:09:48.105692 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. Oct 04 09:09:48.105692 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': 'b1d33b43-1430-4d89-a575-731a73a3f50a'} Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:09:48.106567 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. Oct 04 09:09:48.108677 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.110336 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-29375d93-d5fc-4286-8fc5-4aab673cc586 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Returning 404 to user: Instance b1d33b43-1430-4d89-a575-731a73a3f50a could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:09:48.110336 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-29375d93-d5fc-4286-8fc5-4aab673cc586 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a" status: 404 len: 111 microversion: 2.1 time: 0.031549 Oct 04 09:09:48.110336 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 639/1325] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:09:48 2022] GET /compute/v2.1/servers/b1d33b43-1430-4d89-a575-731a73a3f50a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:09:48.115331 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-47843bca-48c2-49b8-8478-459df1cdf0f0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:48.115828 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-47843bca-48c2-49b8-8478-459df1cdf0f0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:48.122357 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-47843bca-48c2-49b8-8478-459df1cdf0f0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:48.122835 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-47843bca-48c2-49b8-8478-459df1cdf0f0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:48.123265 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-47843bca-48c2-49b8-8478-459df1cdf0f0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:48.123982 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-47843bca-48c2-49b8-8478-459df1cdf0f0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:48.124431 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-47843bca-48c2-49b8-8478-459df1cdf0f0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:48.124847 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-47843bca-48c2-49b8-8478-459df1cdf0f0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:48.138407 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-47843bca-48c2-49b8-8478-459df1cdf0f0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] HTTP exception thrown: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-47843bca-48c2-49b8-8478-459df1cdf0f0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Request method failure captured: Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: DELETE /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e HTTP/1.1 Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_bNdsNoR1EJ0YryrP3LxGOA4CSKhOV3N2YTX5dRZGWbSMozvy9Uq2nzgH9fYhwhF5fUR2ahiSmulkP-Pv3i4rylMex1AwqCGffErBnDQcsWSLyokVVRtYTA5obgs2izUVEr7P4VXXwmn8LiZUH2LRl7KuHI9xyIQSl2BhPVU8SoXAk Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:09:48.139972 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:09:48.141591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89b56ee603d34a5f85f7e007b2fe668f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:09:48.141591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:48.141591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:48.141591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:48.141591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:48.141591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:09:48.141591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:09:48.141591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 3ec88da1704d44fb924fa3cc04e5fe25 Oct 04 09:09:48.141591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:48.141591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:09:48.141591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. Oct 04 09:09:48.141591 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': '3857fa0e-9f45-4f4f-91e4-565557da917e'} Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:09:48.142680 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. Oct 04 09:09:48.144363 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.146084 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-47843bca-48c2-49b8-8478-459df1cdf0f0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Returning 404 to user: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:09:48.146084 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-47843bca-48c2-49b8-8478-459df1cdf0f0 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 404 len: 111 microversion: 2.1 time: 0.030284 Oct 04 09:09:48.146084 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 687/1326] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:09:48 2022] DELETE /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 09:09:48.149876 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-de537fe5-5e7c-492e-9e67-558853dfee92 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:48.150496 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-de537fe5-5e7c-492e-9e67-558853dfee92 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 3857fa0e-9f45-4f4f-91e4-565557da917e] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:48.156628 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-de537fe5-5e7c-492e-9e67-558853dfee92 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:48.157186 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-de537fe5-5e7c-492e-9e67-558853dfee92 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:48.157545 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-de537fe5-5e7c-492e-9e67-558853dfee92 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:48.158227 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-de537fe5-5e7c-492e-9e67-558853dfee92 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:48.158679 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-de537fe5-5e7c-492e-9e67-558853dfee92 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:48.159099 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-de537fe5-5e7c-492e-9e67-558853dfee92 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:48.172859 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-de537fe5-5e7c-492e-9e67-558853dfee92 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] HTTP exception thrown: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-de537fe5-5e7c-492e-9e67-558853dfee92 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Request method failure captured: Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e HTTP/1.1 Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_bNdsNoR1EJ0YryrP3LxGOA4CSKhOV3N2YTX5dRZGWbSMozvy9Uq2nzgH9fYhwhF5fUR2ahiSmulkP-Pv3i4rylMex1AwqCGffErBnDQcsWSLyokVVRtYTA5obgs2izUVEr7P4VXXwmn8LiZUH2LRl7KuHI9xyIQSl2BhPVU8SoXAk Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:09:48.174384 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:09:48.176220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89b56ee603d34a5f85f7e007b2fe668f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:09:48.176220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:48.176220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:48.176220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:48.176220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:48.176220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:09:48.176220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:09:48.176220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 3ec88da1704d44fb924fa3cc04e5fe25 Oct 04 09:09:48.176220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:48.176220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:09:48.176220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. Oct 04 09:09:48.176220 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': '3857fa0e-9f45-4f4f-91e4-565557da917e'} Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:09:48.177357 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. Oct 04 09:09:48.179048 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:48.180712 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-de537fe5-5e7c-492e-9e67-558853dfee92 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Returning 404 to user: Instance 3857fa0e-9f45-4f4f-91e4-565557da917e could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:09:48.180712 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-de537fe5-5e7c-492e-9e67-558853dfee92 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e" status: 404 len: 111 microversion: 2.1 time: 0.029826 Oct 04 09:09:48.180712 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 640/1327] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:09:48 2022] GET /compute/v2.1/servers/3857fa0e-9f45-4f4f-91e4-565557da917e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:09:49.331312 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-dc63a6d3-f3a0-4483-a08c-d5ccb0ce5d91 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:49.331819 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.compute.api [None req-dc63a6d3-f3a0-4483-a08c-d5ccb0ce5d91 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142438) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:49.343017 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc63a6d3-f3a0-4483-a08c-d5ccb0ce5d91 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:49.344608 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc63a6d3-f3a0-4483-a08c-d5ccb0ce5d91 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:49.345046 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc63a6d3-f3a0-4483-a08c-d5ccb0ce5d91 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:49.345753 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc63a6d3-f3a0-4483-a08c-d5ccb0ce5d91 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:49.346201 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc63a6d3-f3a0-4483-a08c-d5ccb0ce5d91 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:49.346620 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG oslo_concurrency.lockutils [None req-dc63a6d3-f3a0-4483-a08c-d5ccb0ce5d91 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:49.360845 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.wsgi [None req-dc63a6d3-f3a0-4483-a08c-d5ccb0ce5d91 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] HTTP exception thrown: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-dc63a6d3-f3a0-4483-a08c-d5ccb0ce5d91 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Request method failure captured: Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: request: DELETE /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 HTTP/1.1 Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept: application/json Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Accept-Encoding: identity Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Connection: close Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Length: 0 Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Content-Type: application/json Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Host: 10.222.0.44 Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: Openstack-System-Scope: None Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: User-Agent: python-urllib3/1.26.12 Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Auth-Token: gAAAAABjO_bNdsNoR1EJ0YryrP3LxGOA4CSKhOV3N2YTX5dRZGWbSMozvy9Uq2nzgH9fYhwhF5fUR2ahiSmulkP-Pv3i4rylMex1AwqCGffErBnDQcsWSLyokVVRtYTA5obgs2izUVEr7P4VXXwmn8LiZUH2LRl7KuHI9xyIQSl2BhPVU8SoXAk Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Id: None Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Domain-Name: None Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Identity-Status: Confirmed Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Is-Admin-Project: True Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Id: default Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Domain-Name: Default Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Project-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Role: member,reader Oct 04 09:09:49.362413 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Roles: member,reader Oct 04 09:09:49.364511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89b56ee603d34a5f85f7e007b2fe668f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:09:49.364511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:49.364511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:49.364511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:49.364511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:49.364511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Id: default Oct 04 09:09:49.364511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Domain-Name: Default Oct 04 09:09:49.364511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Id: 3ec88da1704d44fb924fa3cc04e5fe25 Oct 04 09:09:49.364511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: X-User-Name: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:49.364511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: method: > Oct 04 09:09:49.364511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: exception: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. Oct 04 09:09:49.364511 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: action_args: {'id': '234fb5e1-513f-4c6e-bce8-43580ed70303'} Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: {{(pid=142438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:09:49.365478 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. Oct 04 09:09:49.367175 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: ERROR nova.api.openstack.wsgi Oct 04 09:09:49.369342 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: DEBUG nova.api.openstack.wsgi [None req-dc63a6d3-f3a0-4483-a08c-d5ccb0ce5d91 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Returning 404 to user: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. {{(pid=142438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:09:49.369342 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: INFO nova.api.openstack.requestlog [None req-dc63a6d3-f3a0-4483-a08c-d5ccb0ce5d91 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "DELETE /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 404 len: 111 microversion: 2.1 time: 0.036397 Oct 04 09:09:49.369342 dv-cinder-844563-14-iscsi devstack@n-api.service[142438]: [pid: 142438|app: 0|req: 688/1328] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Oct 4 09:09:49 2022] DELETE /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:09:49.376633 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-be539e5e-b67e-4668-b05d-d91048b92698 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Calling method '>' {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:09:49.377608 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.compute.api [None req-be539e5e-b67e-4668-b05d-d91048b92698 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] [instance: 234fb5e1-513f-4c6e-bce8-43580ed70303] Fetching instance by UUID {{(pid=142439) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:09:49.386354 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be539e5e-b67e-4668-b05d-d91048b92698 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:49.386838 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be539e5e-b67e-4668-b05d-d91048b92698 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:49.387339 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be539e5e-b67e-4668-b05d-d91048b92698 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:49.388076 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be539e5e-b67e-4668-b05d-d91048b92698 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Acquiring lock "741e120e-a520-4525-9dbb-b6709af0a52b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:09:49.388535 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be539e5e-b67e-4668-b05d-d91048b92698 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:09:49.388959 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG oslo_concurrency.lockutils [None req-be539e5e-b67e-4668-b05d-d91048b92698 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Lock "741e120e-a520-4525-9dbb-b6709af0a52b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142439) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:09:49.402591 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.wsgi [None req-be539e5e-b67e-4668-b05d-d91048b92698 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] HTTP exception thrown: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-be539e5e-b67e-4668-b05d-d91048b92698 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Request method failure captured: Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: request: GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 HTTP/1.1 Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept: application/json Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Accept-Encoding: identity Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Connection: close Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Length: 0 Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Content-Type: application/json Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Host: 10.222.0.44 Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: Openstack-System-Scope: None Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: User-Agent: python-urllib3/1.26.12 Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Auth-Token: gAAAAABjO_bNdsNoR1EJ0YryrP3LxGOA4CSKhOV3N2YTX5dRZGWbSMozvy9Uq2nzgH9fYhwhF5fUR2ahiSmulkP-Pv3i4rylMex1AwqCGffErBnDQcsWSLyokVVRtYTA5obgs2izUVEr7P4VXXwmn8LiZUH2LRl7KuHI9xyIQSl2BhPVU8SoXAk Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Id: None Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Domain-Name: None Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Identity-Status: Confirmed Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Is-Admin-Project: True Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Id: default Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Domain-Name: Default Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Project-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Role: member,reader Oct 04 09:09:49.404145 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Roles: member,reader Oct 04 09:09:49.405865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89b56ee603d34a5f85f7e007b2fe668f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89b56ee603d34a5f85f7e007b2fe668f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] Oct 04 09:09:49.405865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:49.405865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Id: 89b56ee603d34a5f85f7e007b2fe668f Oct 04 09:09:49.405865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-38841594 Oct 04 09:09:49.405865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:49.405865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Id: default Oct 04 09:09:49.405865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Domain-Name: Default Oct 04 09:09:49.405865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Id: 3ec88da1704d44fb924fa3cc04e5fe25 Oct 04 09:09:49.405865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: X-User-Name: tempest-AttachVolumeNegativeTest-38841594-project Oct 04 09:09:49.405865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: method: > Oct 04 09:09:49.405865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: exception: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. Oct 04 09:09:49.405865 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: action_args: {'id': '234fb5e1-513f-4c6e-bce8-43580ed70303'} Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: {{(pid=142439) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:09:49.406889 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. Oct 04 09:09:49.408569 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: ERROR nova.api.openstack.wsgi Oct 04 09:09:49.410082 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: DEBUG nova.api.openstack.wsgi [None req-be539e5e-b67e-4668-b05d-d91048b92698 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] Returning 404 to user: Instance 234fb5e1-513f-4c6e-bce8-43580ed70303 could not be found. {{(pid=142439) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:09:49.410082 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: INFO nova.api.openstack.requestlog [None req-be539e5e-b67e-4668-b05d-d91048b92698 tempest-AttachVolumeNegativeTest-38841594 tempest-AttachVolumeNegativeTest-38841594-project] 10.222.0.44 "GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303" status: 404 len: 111 microversion: 2.1 time: 0.035380 Oct 04 09:09:49.410082 dv-cinder-844563-14-iscsi devstack@n-api.service[142439]: [pid: 142439|app: 0|req: 641/1329] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Oct 4 09:09:49 2022] GET /compute/v2.1/servers/234fb5e1-513f-4c6e-bce8-43580ed70303 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)